-- Logs begin at Wed 2022-06-15 15:00:54 UTC, end at Wed 2022-06-15 16:16:18 UTC. -- Jun 15 15:41:15.754133 dv-cinder-845990-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 15:41:15.763512 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 15:41:15.765535 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 15:41:15 2022] *** Jun 15 15:41:15.765535 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 15:41:15.765535 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 15:41:15.765535 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: nodename: dv-cinder-845990-1-iscsi Jun 15 15:41:15.765535 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: machine: x86_64 Jun 15 15:41:15.765535 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: clock source: unix Jun 15 15:41:15.765535 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: pcre jit disabled Jun 15 15:41:15.765535 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: detected number of CPU cores: 4 Jun 15 15:41:15.765535 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: current working directory: / Jun 15 15:41:15.765535 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: detected binary path: /usr/bin/uwsgi-core Jun 15 15:41:15.766174 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: your processes number limit is 47680 Jun 15 15:41:15.766174 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: your memory page size is 4096 bytes Jun 15 15:41:15.766174 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: detected max file descriptor number: 2048 Jun 15 15:41:15.766174 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: lock engine: pthread robust mutexes Jun 15 15:41:15.766174 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: thunder lock: enabled Jun 15 15:41:15.766174 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 15:41:15.766174 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 15:41:15.809375 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: Python main interpreter initialized at 0x5566533b09c0 Jun 15 15:41:15.809375 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: python threads support enabled Jun 15 15:41:15.809375 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: your server socket listen backlog is limited to 100 connections Jun 15 15:41:15.809375 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: your mercy for graceful operations on workers is 90 seconds Jun 15 15:41:15.809737 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 15:41:15.809814 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: *** Operational MODE: preforking *** Jun 15 15:41:15.810016 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: *** uWSGI is running in multiple interpreter mode *** Jun 15 15:41:15.810016 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: spawned uWSGI master process (pid: 109582) Jun 15 15:41:15.810188 dv-cinder-845990-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 15:41:15.811978 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: spawned uWSGI worker 1 (pid: 109583, cores: 1) Jun 15 15:41:15.811978 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: spawned uWSGI worker 2 (pid: 109584, cores: 1) Jun 15 15:41:15.811978 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 15:41:16.469963 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 15:41:16.482113 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 15:41:17.642390 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 15:41:17.642390 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: from cryptography.utils import int_from_bytes Jun 15 15:41:17.642990 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 15:41:17.642990 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: from cryptography.utils import int_from_bytes Jun 15 15:41:17.645716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 15:41:17.645716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: from cryptography.utils import int_from_bytes Jun 15 15:41:17.646762 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 15:41:17.646762 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: from cryptography.utils import int_from_bytes Jun 15 15:41:20.201274 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 15:41:20.201860 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 15:41:20.202059 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 15:41:20.202182 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 15:41:20.202534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 15:41:20.202617 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 15:41:20.202700 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 15:41:20.202866 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 15:41:20.203075 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.203227 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 15:41:20.203398 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.203488 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 15:41:20.203721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.203859 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.204040 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.204186 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.204368 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.204510 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.204680 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.204831 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.205000 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.205163 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.205317 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.205475 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.205643 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.205798 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.205894 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.206118 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.206205 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.206449 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.206548 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-1-iscsi {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.206712 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.206845 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.207049 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.207137 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.207378 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-1-iscsi {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.207479 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.207700 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.207814 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.208011 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.208106 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.208323 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.208422 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.208637 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.208723 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.208961 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.209804 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.209911 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.210114 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.210288 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.210601 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.210761 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.210939 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.211057 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.211246 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.211337 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.211560 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.211652 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.211896 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.212215 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.212523 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.212612 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.212844 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.212941 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.213154 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.213249 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.213478 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.213565 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.213793 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.213887 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.214193 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-1-iscsi {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.214293 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-1-iscsi {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.214510 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.214595 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.214845 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.214936 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.215161 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.215323 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.215572 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.215674 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.215885 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.215985 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.216193 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.216279 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.216509 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.216595 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.216831 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.216926 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.217135 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.217225 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.217459 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.217557 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.217775 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.217864 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.218091 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.218178 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.218407 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.218494 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.218708 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.218864 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.219040 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.219129 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.219347 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.219433 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.219663 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.219751 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.219966 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.220063 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.220268 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.220370 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.220516 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.220609 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.220822 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.220908 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.221139 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.221238 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.221456 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.221543 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.221832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.221922 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.222169 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.222274 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.222430 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.222580 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.222822 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.223107 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.223210 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.223451 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.223657 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.223751 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.224120 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.224215 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.224518 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.224614 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.224832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.225089 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.225176 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.225491 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.225586 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.225802 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.226123 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.226220 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.226446 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.226634 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.226787 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.226990 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.227138 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.227317 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.227476 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.227692 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.227946 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.228093 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.228247 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.228385 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.228528 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.228664 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.228827 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.228963 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.229146 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.229293 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.229442 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.229577 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.229757 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.229895 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.230079 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.230228 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.230393 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.230532 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.230700 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.230826 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.231036 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.231137 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.231356 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.231531 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.231691 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.231780 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.231997 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.232096 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.232250 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.232339 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.232556 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.232664 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.232864 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.232984 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.233185 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.233280 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.233468 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.233564 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.233780 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.233884 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.234086 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.234181 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.234385 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.234480 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.234692 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.234827 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.235089 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.235181 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.235462 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.235570 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.235774 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.236035 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.236129 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.236429 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.236553 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.236740 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.237050 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.237137 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.237454 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.237564 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.237798 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.237974 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.238163 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.238462 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.238552 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.238792 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.239047 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.239146 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.239400 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.239613 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.239721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.240113 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.240200 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.240492 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.240587 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.240849 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.241077 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.241164 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.241454 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.241602 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.241826 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.242135 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.242221 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.242443 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.242527 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.242783 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.242887 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.243090 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.243189 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.243401 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.243502 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.243718 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.243813 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.244026 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.244113 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.244333 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.244418 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.244639 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.244745 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.244943 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.245031 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.245247 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.245333 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.245553 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.245651 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.245858 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.245943 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.246161 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.246247 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.246461 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.246549 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.246790 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.246879 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.247117 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.247203 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.247422 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.247513 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.247729 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.247815 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.248030 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.248117 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.248336 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.248430 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.248645 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.248746 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.248955 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.249066 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.249267 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.249372 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.249573 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.249666 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.249876 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.249972 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.250197 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.250285 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.250522 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.250607 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.250856 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.250958 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.251170 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.251258 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.251481 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.251567 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.251790 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.251884 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:41:20.252102 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.252188 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.252415 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.252501 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.252733 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.252868 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.253051 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.253144 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.253381 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.253467 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.253700 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.253803 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.254016 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.254102 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.254333 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.254417 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.254640 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.254744 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.254992 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.255092 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.255305 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.255888 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.256151 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.256239 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.256460 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.256544 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.256779 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.256864 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.257102 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.257189 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.257424 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.257514 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.257743 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.257833 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.258063 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.258150 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.258371 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.258454 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.258683 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.258817 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.259019 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.259106 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.259343 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.259441 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.259661 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.259819 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.259972 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.260066 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.260547 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.260639 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.260866 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.260966 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.261179 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.261273 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.261490 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.261576 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.261810 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.261949 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.262113 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.262199 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.262425 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.262513 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.262762 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.262864 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.263071 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.263159 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.263385 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.263471 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.263701 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.263787 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.264011 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.264095 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.264323 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.264408 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.264633 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.264725 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.264936 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.265028 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.265240 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.265328 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.265545 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.265645 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.265854 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.265940 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.266156 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.266260 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.266476 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.266563 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.266815 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.266904 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.267124 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.267229 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.267438 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.267523 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.267747 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.267836 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.268058 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.268207 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.268363 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.268458 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.268669 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.268754 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.268973 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.269071 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.269279 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.269380 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.269584 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.269689 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.269882 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.269977 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.270203 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.270290 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.270509 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.270599 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.270845 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.270977 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.271725 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.271831 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.272035 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.272132 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.272345 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.272444 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.272655 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.272751 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.272981 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.273075 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.273275 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.273373 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.273582 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.273670 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.273888 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.273990 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.274208 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.274296 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.274516 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.274610 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.274847 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.274950 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.275172 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.275261 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.275482 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.275571 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.275788 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.275886 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.276106 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.276195 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.276418 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.276506 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.276731 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.276827 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.277036 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.277125 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.277345 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.277432 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.277648 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.277737 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.277954 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.278065 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.278261 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.278358 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.278567 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.278658 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.278910 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.279000 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.279215 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.279303 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.279520 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.279611 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.279824 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.279911 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.280128 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.280216 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.280449 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.280538 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.280759 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.280848 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.281060 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.281160 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.281364 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.281453 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.281667 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.281754 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.281976 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.282071 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.282287 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.282375 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.282598 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.282687 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.282931 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.283034 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.283241 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.283329 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.283551 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.283638 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.283878 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.283979 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.284189 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.284275 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.284496 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.284583 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.284805 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.284895 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.285114 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.285202 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.285424 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.285509 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.285744 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.285841 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.286056 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.286145 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.286375 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.286462 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.286708 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.286815 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.287056 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.287156 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.287369 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.287458 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.287684 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.287772 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.287985 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.288079 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.288300 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.288399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.288613 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.288701 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.288931 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.289026 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.289255 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.289430 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.289571 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.289671 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.289880 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.289977 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.290191 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.290288 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.290496 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.290584 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.290847 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.290980 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.291155 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.291268 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.291462 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.291551 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.291780 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.291876 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.292090 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.292189 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.292408 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.292535 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.292716 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.292803 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.293038 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.293134 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.293348 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.293445 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.293666 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.293751 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.293968 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.294054 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.294281 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.294376 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.294592 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.294677 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.294931 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.295021 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.295271 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.295358 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.295568 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.295654 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.295883 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.295977 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.296192 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.296277 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.296497 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.296589 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.296808 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.296903 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.297112 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.297199 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.297416 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.297515 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.297722 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.297807 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.298034 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.298129 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.298345 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.298511 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.298653 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.298762 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.298983 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.299077 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.299295 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.299390 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.299603 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.299691 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.299912 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.299998 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.300227 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.300330 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.300535 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.300622 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.300846 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.300933 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.301158 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.301246 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.301475 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.301567 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.301786 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.301872 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.302095 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.302197 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.302422 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.302507 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.302753 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.302858 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.303069 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.303155 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.303373 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.303459 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.303676 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.303761 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.303977 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.304063 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.304305 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.304389 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.304614 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.304709 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.304919 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.305006 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.305236 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.305329 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.305539 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.305639 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.305847 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.305934 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.306157 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.306242 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.306465 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.306559 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.306792 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.306881 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.307099 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.307184 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.307407 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.307513 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.307713 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.307797 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.308026 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.308113 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.308347 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.308491 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.308652 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.308742 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.308963 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.309058 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.309269 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.309356 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.309582 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.309668 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.309892 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.310014 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.310200 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.310287 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.310509 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.310595 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.310842 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.310942 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.311155 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.311243 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.311470 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.311717 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.311814 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.312047 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.312136 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.312363 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.312450 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.312681 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.312774 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.312988 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.313082 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.313302 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.313389 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.313616 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.313702 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.313928 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.314016 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.314243 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.314337 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.314562 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.314664 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.314895 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.315147 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.315237 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.315481 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.315567 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.315790 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.315883 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.316097 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.316186 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.316402 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.316489 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.316706 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.316800 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.317015 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.317103 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.317318 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.317404 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.317622 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.317717 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.318434 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.318582 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.318782 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.318877 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.319076 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.319163 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.319380 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.319469 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.319692 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.319778 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.319996 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.320126 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.320304 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.320393 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.320610 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.320696 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.320914 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.321001 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.321215 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.321301 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.321518 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.321603 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.321820 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.321905 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.322126 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.322213 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.322440 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.322527 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.322768 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.322907 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.323084 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.323186 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.323391 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.323490 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.323711 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.323819 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.324017 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.324132 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.324323 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.324428 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.324626 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.324725 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.324929 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.325027 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.325236 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.325325 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.325544 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.325641 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.325848 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.325945 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.326159 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.326248 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.326466 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.326557 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.326841 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.326945 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.327153 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.327249 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.327454 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.327550 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.327763 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.327850 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.328067 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.328160 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.328373 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.328463 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.328687 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.328773 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.328982 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.329079 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.329283 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.329372 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.329587 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.329673 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.329892 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.329988 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.330196 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.330303 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.330498 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.330586 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.330818 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.330921 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.331128 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.331215 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.331428 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.331514 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.331729 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.331830 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.332029 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.332119 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.332330 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.332416 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.332633 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.332731 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.332931 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.333018 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.333235 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.333322 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.333644 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.334216 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.334447 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.334575 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.334771 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.334950 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.335085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.335304 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.335407 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.335640 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.335729 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.335969 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.336066 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.336286 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.336374 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.336600 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.336688 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.336905 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.337002 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.337216 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.337311 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.337524 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.337663 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.337830 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.337970 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.338118 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.338253 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.338425 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.338558 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.338741 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.338889 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.339050 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.339140 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.339354 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.339443 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.339656 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.339746 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.339957 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.340046 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.340281 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.340398 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.340589 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.340697 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.340892 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.340990 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.341200 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.341310 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.341502 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.341605 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.341840 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.341981 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.342128 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.342269 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.342461 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.342598 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.342789 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.342933 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.343104 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.343317 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.343454 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.343587 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.343722 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.343854 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.344018 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.344169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.344346 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.344480 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.344636 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.344773 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.344947 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.345082 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.345254 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.345389 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.345566 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.345701 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.345869 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.346018 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.346173 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.346317 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.346491 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.346636 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.346811 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.346951 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.347121 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.347257 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.347439 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.347582 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.347759 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.347848 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.348082 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.348169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.348384 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.348471 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.348692 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.348794 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.349016 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.349104 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.349310 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.349407 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.349616 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.349711 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.349923 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.350008 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.350228 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.350328 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.350541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.350631 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.350878 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.351208 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.351304 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.351536 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.351624 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.351866 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.351953 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.352175 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.352260 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.352488 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.352574 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.352796 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.352889 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.353103 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.353197 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.353416 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.353501 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.353725 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.353810 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.354032 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.354127 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.354342 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.354435 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.354649 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.354756 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.354987 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.355084 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.355293 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.355380 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.355604 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.355716 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.355921 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.356016 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.356237 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.356332 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.356549 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.356635 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.356879 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.356967 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.357194 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.357281 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.357506 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.357632 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.357817 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.357903 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.358121 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.358217 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.358433 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.358518 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.358758 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.358850 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.359156 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.359252 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.359468 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.359566 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.359775 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.359862 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.360080 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.360166 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.360391 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.360486 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.360706 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.360859 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.361013 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.361107 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.361318 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.361418 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.361624 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.361710 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.361943 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.362074 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.362249 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.362344 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.362570 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.362665 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.362991 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.363090 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.363303 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.363399 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.363606 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.363703 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.363925 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.364011 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.364255 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.364343 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.364566 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.364653 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.364875 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.364961 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.365185 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.365273 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.365511 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.365606 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.365823 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.365910 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.366137 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.366222 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.366447 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.366556 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.366789 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.366901 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.367114 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.367202 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.367425 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.367623 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.367773 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.367942 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.368031 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.368258 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.368359 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.368586 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.368680 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.368912 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.369009 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.369242 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.369339 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.369547 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.369655 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.369864 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.369981 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.370179 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.370292 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.370507 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.370615 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.370856 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.370988 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.371176 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.371266 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.371497 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.371584 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.371806 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.371892 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.372133 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.372222 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.372436 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.372521 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.372754 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.372857 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.373059 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.373156 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.373368 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.373467 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.373676 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.373799 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.373984 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.374116 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.374289 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.374442 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.374593 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.374796 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.374928 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.375115 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.375227 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.375428 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.375527 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.375746 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.375846 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.376060 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.376159 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.376371 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.376479 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.376699 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.376799 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.377008 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.377114 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.377325 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.377431 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.377630 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.377772 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.377935 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.378033 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.378239 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.378350 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.378548 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.378645 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.378897 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.378994 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.379225 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.379337 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.379529 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.379627 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.379846 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.379934 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.380152 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.380241 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.380971 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.381074 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.381280 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.381371 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.381607 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.381705 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.381922 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.382010 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.382230 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.382316 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.382537 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.382625 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.382864 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.382969 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.383176 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.383265 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.383483 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.383575 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.383787 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.383877 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.384091 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.384187 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.384398 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.384486 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.384699 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.384787 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.385001 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.385103 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.385560 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.385663 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.385881 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.385969 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.386187 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.386284 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.386509 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.386598 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.386840 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.386930 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.387148 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.387251 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.387454 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.387543 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.387759 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.387847 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.388088 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.388180 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.388391 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.388485 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.388702 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.388789 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.389010 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.389100 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.389317 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.389443 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.389626 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.389718 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.389940 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.390029 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.390247 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.390333 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.390566 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.390654 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.390958 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.391111 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.391200 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.391270 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.391499 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.391598 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.391809 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.391900 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.392120 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.392206 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.392446 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.392587 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.392745 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.392834 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.393061 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.393149 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.393375 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.393473 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.393693 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.393783 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.394016 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.394208 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.394344 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.394539 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.394668 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.394881 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.395016 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.395198 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.395355 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.395511 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.395662 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.395825 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.395984 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.396190 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.396857 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.396995 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.397182 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.397308 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.397497 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.397621 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.397822 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.397933 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.398145 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.398261 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.398470 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.398636 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.398924 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.399015 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.399264 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.399355 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.399583 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.399681 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.399901 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.399998 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.400216 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.400321 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.400531 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.400644 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.400860 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.400975 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.401176 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.401297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.401493 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.401606 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.401809 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.401923 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.402127 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.402289 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.402461 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.402552 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.402815 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.402925 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.403149 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.403239 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.403460 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.403549 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.403773 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.403861 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.404084 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.404186 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.404394 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.404483 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.404705 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.404802 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.405018 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.405116 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.405340 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.405429 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.405669 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.405757 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.405984 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.406073 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.406297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.406385 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.406609 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.406706 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.406949 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.407041 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.407266 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.407465 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.407585 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.407785 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.407888 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.408121 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.408210 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.408448 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.408544 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.408774 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.408864 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.409092 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.409187 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.409409 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.409512 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.409767 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.409870 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.410044 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.410142 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.410351 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.410440 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.410662 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.410800 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.411006 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.411095 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.411309 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.411525 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.411632 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.411844 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.411955 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.412263 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.412583 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.412894 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.413420 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.413766 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.414087 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.414176 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.414412 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.414508 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.414751 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.415076 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.415226 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.415385 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.415580 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.415707 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.415929 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.416020 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.416306 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.416417 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.416622 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.416932 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.417239 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.417543 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.417694 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.417923 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.418045 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.418389 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.418478 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.418710 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.419046 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.419354 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.419746 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.419989 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.420296 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.420604 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.420918 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.421233 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.421538 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.421844 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.422148 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.422460 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.422790 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.423103 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.423410 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.423723 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.424029 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.424337 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.424689 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.425012 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.425317 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.425621 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.425937 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.426027 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.426247 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.426885 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.426978 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.427205 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.427303 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.427543 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.427639 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.427893 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.427983 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.428211 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.428300 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.428561 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.428745 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.429079 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.429176 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.429401 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.429497 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.429737 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.429850 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.430072 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.430172 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.430379 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.430467 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.430686 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.430823 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.431018 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.431106 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.431345 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.431433 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.431658 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.431749 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.434442 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.434597 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.434712 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.434875 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.435003 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.435124 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.435235 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.435343 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.435451 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.435560 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.435678 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.435795 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.435909 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.436025 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.436135 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.436244 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.436431 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.436544 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.436653 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.436783 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.436878 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.436969 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437061 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437145 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437226 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437315 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437398 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437488 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437580 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437663 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437744 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437825 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437905 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.437995 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.438084 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.438166 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.438248 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.438335 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.438418 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.438548 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.438639 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.438722 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.438870 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.438963 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.439047 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.439136 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.439219 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.439301 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.439390 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.439472 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.439561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.439644 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.439893 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.439984 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.440210 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.440312 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.440527 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.440618 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.440850 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.440938 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.441161 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.441250 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.441488 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.441586 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.441809 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.441900 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.442122 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.442228 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.442439 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.442535 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.442762 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.442853 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.443618 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.443726 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.444339 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.444484 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.444606 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.444717 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.444834 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.444964 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.445075 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.445190 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.445300 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.445454 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.445582 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.445806 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.445931 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.446071 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.446194 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.446376 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.446505 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.446680 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.446819 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.447017 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.447134 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.447324 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.447452 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.447627 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.447744 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.447930 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.448047 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.448233 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.448358 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.448988 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.449077 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.449161 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.449251 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.449335 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.449416 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.449505 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.449593 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.449676 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.449766 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.449977 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.450068 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.450282 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.450407 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.450584 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.450693 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.450915 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.451008 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.451218 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.451351 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.451524 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.451633 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.451829 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.451917 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.452133 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.452232 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.452432 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.452522 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.452763 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.452851 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.453090 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.453186 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.453402 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.453491 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.453722 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.453817 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.454031 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.454142 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.454351 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.454450 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.454656 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.454764 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.454990 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.455090 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.455325 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.455412 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.455638 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.455725 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.455948 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.456045 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.456277 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.456365 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.456587 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.456682 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.456898 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.457000 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.457209 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.457296 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.457516 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.457603 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.457823 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.457927 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.458131 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.458226 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.458455 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.458578 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.459360 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.459469 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.459665 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.459752 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.459985 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.460074 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.460301 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.460387 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.460621 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.460732 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.460937 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.461027 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.461248 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.461338 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.461566 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.461652 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.461878 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.461973 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.462188 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.462357 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.462503 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.462650 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.462829 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.462977 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.463117 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.463261 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.463414 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.463504 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.463724 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.463892 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.464034 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.464124 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.464354 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.464455 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.464657 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.464756 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.464963 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.465051 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.465272 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.465363 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.465584 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.465674 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.465894 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.465994 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.466204 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.466293 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.466518 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.466608 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.466853 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.466948 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.467166 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.467255 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.467477 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.467567 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.467717 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 15:41:20.467805 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.468081 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.468416 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.468751 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.469073 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.469401 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.469718 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.470046 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.470359 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.470688 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.471034 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.471360 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.471678 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.472016 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.472332 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.472650 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.472965 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.473281 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.473596 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.473912 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.474274 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.476489 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.476833 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.477614 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.477968 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.478448 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.478829 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.480103 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.480469 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.487970 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.488802 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.489168 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.489521 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.489895 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.490244 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.490589 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.490973 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.491324 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.491656 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.492002 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.492347 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.492716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.493048 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.493407 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.493749 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.494080 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.494411 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.494760 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:41:20.495016 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 15:41:20.531850 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO dbcounter [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Registered counter for database nova_api Jun 15 15:41:20.553415 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG oslo_db.sqlalchemy.engines [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:41:20.558427 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO dbcounter [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Registered counter for database nova_api Jun 15 15:41:20.559895 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG dbcounter [-] [109583] Writer thread running {{(pid=109583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:41:20.578434 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_db.sqlalchemy.engines [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:41:20.584816 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writer thread running {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:41:20.616914 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.context [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a7cda08c-8d99-4c22-b02a-df5ced6c50f0(cell1) {{(pid=109583) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 15:41:20.621058 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG oslo_concurrency.lockutils [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:41:20.622624 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG oslo_concurrency.lockutils [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:41:20.623442 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG oslo_concurrency.lockutils [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:41:20.625386 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG oslo_concurrency.lockutils [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:41:20.627337 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO dbcounter [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Registered counter for database nova_cell0 Jun 15 15:41:20.631741 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO dbcounter [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Registered counter for database nova_cell1 Jun 15 15:41:20.639189 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG oslo_db.sqlalchemy.engines [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:41:20.641331 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG oslo_db.sqlalchemy.engines [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:41:20.642401 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.context [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a7cda08c-8d99-4c22-b02a-df5ced6c50f0(cell1) {{(pid=109584) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 15:41:20.646581 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:41:20.646696 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG dbcounter [-] [109583] Writer thread running {{(pid=109583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:41:20.648233 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:41:20.648706 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG dbcounter [-] [109583] Writer thread running {{(pid=109583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:41:20.649036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:41:20.651081 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:41:20.653056 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO dbcounter [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Registered counter for database nova_cell0 Jun 15 15:41:20.656924 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO dbcounter [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Registered counter for database nova_cell1 Jun 15 15:41:20.664295 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_db.sqlalchemy.engines [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:41:20.668101 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_db.sqlalchemy.engines [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:41:20.669857 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writer thread running {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:41:20.791038 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO dbcounter [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Registered counter for database nova_cell0 Jun 15 15:41:20.799527 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG oslo_db.sqlalchemy.engines [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:41:20.804323 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG dbcounter [-] [109583] Writer thread running {{(pid=109583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:41:20.808507 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writer thread running {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:41:20.818755 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO dbcounter [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Registered counter for database nova_cell0 Jun 15 15:41:20.827342 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_db.sqlalchemy.engines [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:41:20.832077 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writer thread running {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:41:21.140155 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: WARNING keystonemiddleware.auth_token [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 15:41:21.146199 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: WARNING keystonemiddleware.auth_token [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 15:41:21.147461 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: WARNING keystonemiddleware.auth_token [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 15:41:21.153407 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: WARNING keystonemiddleware.auth_token [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 15:41:21.493857 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: WARNING keystonemiddleware.auth_token [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 15:41:21.496561 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: WARNING keystonemiddleware.auth_token [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 15:41:21.499888 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: WARNING keystonemiddleware.auth_token [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 15:41:21.502460 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: WARNING keystonemiddleware.auth_token [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 15:41:21.504928 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566533b09c0 pid: 109583 (default app) Jun 15 15:41:21.507064 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:41:21.507792 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5566533b09c0 pid: 109584 (default app) Jun 15 15:41:21.508314 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-25ce8d1f-7a32-47d2-8ef9-239550e18ba6 None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001819 Jun 15 15:41:21.508721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Wed Jun 15 15:41:21 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:42:37.585341 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:37.586557 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001954 Jun 15 15:42:37.586983 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:42:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:42:37.602396 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG dbcounter [-] [109583] Writing DB stats nova_api:SELECT=3 {{(pid=109583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:42:37.603560 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG dbcounter [-] [109583] Writing DB stats nova_cell1:SELECT=3 {{(pid=109583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:42:37.604402 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG dbcounter [-] [109583] Writing DB stats nova_cell0:SELECT=3 {{(pid=109583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:42:37.605469 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG dbcounter [-] [109583] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:42:38.023756 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-9feef39e-67d3-4240-9a46-03bc218272ab admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:38.053807 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-9feef39e-67d3-4240-9a46-03bc218272ab admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.461118 Jun 15 15:42:38.054467 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 2/3] 10.222.0.62 () {60 vars in 1291 bytes} [Wed Jun 15 15:42:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:42:40.213990 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:40.215739 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-9dc4e33f-5798-40fc-92ba-c112f0890fbe None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002181 Jun 15 15:42:40.216349 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 2/4] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:42:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:42:40.278646 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-7bc2ca42-3ff2-4301-abff-4cb38117550c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:40.296706 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 15:42:40.296706 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: warnings.warn(msg) Jun 15 15:42:40.325498 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-7bc2ca42-3ff2-4301-abff-4cb38117550c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102369 Jun 15 15:42:40.326040 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 3/5] 10.222.0.62 () {64 vars in 1282 bytes} [Wed Jun 15 15:42:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:42:40.339508 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writing DB stats nova_api:SELECT=3 {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:42:40.340299 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writing DB stats nova_cell0:SELECT=3 {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:42:40.341034 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writing DB stats nova_cell1:SELECT=3 {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:42:40.342038 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writing DB stats nova_cell0:SELECT=3 {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:42:40.554351 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-be71f619-b405-4df1-9498-e7e7cbeee96e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:40.556829 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 15:42:40.556829 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: warnings.warn(msg) Jun 15 15:42:40.629278 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-be71f619-b405-4df1-9498-e7e7cbeee96e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294894 Jun 15 15:42:40.633817 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 3/6] 10.222.0.62 () {64 vars in 1335 bytes} [Wed Jun 15 15:42:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:42:42.851352 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-7bc2ca42-3ff2-4301-abff-4cb38117550c admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:42.852363 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-7bc2ca42-3ff2-4301-abff-4cb38117550c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 15 15:42:42.852935 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 4/7] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:42:42.965224 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-d815cb6d-e88d-4960-87e9-bca76952db1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:42.992619 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 15:42:42.992619 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: warnings.warn(msg) Jun 15 15:42:43.018472 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-d815cb6d-e88d-4960-87e9-bca76952db1a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159984 Jun 15 15:42:43.019099 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 4/8] 10.222.0.62 () {64 vars in 1282 bytes} [Wed Jun 15 15:42:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:42:43.031867 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-541dfc6d-8604-45a5-82ed-d30121fe8b17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:43.033354 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 15:42:43.033354 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: warnings.warn(msg) Jun 15 15:42:43.065569 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-541dfc6d-8604-45a5-82ed-d30121fe8b17 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038105 Jun 15 15:42:43.066083 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 5/9] 10.222.0.62 () {64 vars in 1335 bytes} [Wed Jun 15 15:42:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:42:45.247785 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-d815cb6d-e88d-4960-87e9-bca76952db1a admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:45.249534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-d815cb6d-e88d-4960-87e9-bca76952db1a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Jun 15 15:42:45.250447 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:42:45.318244 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-cf8ee948-8d84-4ed8-8699-6549e0c16f31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G"}} {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:45.340809 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-cf8ee948-8d84-4ed8-8699-6549e0c16f31 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083800 Jun 15 15:42:45.341484 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 6/11] 10.222.0.62 () {64 vars in 1282 bytes} [Wed Jun 15 15:42:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:42:45.353980 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-24e3b334-089a-4503-a83d-7063d25ff7cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:45.377560 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-24e3b334-089a-4503-a83d-7063d25ff7cf admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027407 Jun 15 15:42:45.387190 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 6/12] 10.222.0.62 () {64 vars in 1335 bytes} [Wed Jun 15 15:42:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:42:47.560172 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-cf8ee948-8d84-4ed8-8699-6549e0c16f31 admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:47.561187 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-cf8ee948-8d84-4ed8-8699-6549e0c16f31 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 15 15:42:47.561587 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 7/13] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:42:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:42:47.619373 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-ed49b484-10ec-49b8-afae-1906d16258e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:47.637262 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-ed49b484-10ec-49b8-afae-1906d16258e0 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069799 Jun 15 15:42:47.637801 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 7/14] 10.222.0.62 () {64 vars in 1282 bytes} [Wed Jun 15 15:42:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 15:42:47.649914 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-9132424d-0d77-4b0b-b950-bc78923d0158 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:47.674227 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-9132424d-0d77-4b0b-b950-bc78923d0158 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027828 Jun 15 15:42:47.674851 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 8/15] 10.222.0.62 () {64 vars in 1335 bytes} [Wed Jun 15 15:42:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:42:49.871102 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-ed49b484-10ec-49b8-afae-1906d16258e0 admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:49.872722 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-ed49b484-10ec-49b8-afae-1906d16258e0 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Jun 15 15:42:49.873379 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 8/16] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:42:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:42:49.933302 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-ebf306e5-952c-426a-998f-2827a89f2285 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "disk": 20, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:49.953367 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-ebf306e5-952c-426a-998f-2827a89f2285 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073400 Jun 15 15:42:49.961023 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 9/17] 10.222.0.62 () {64 vars in 1282 bytes} [Wed Jun 15 15:42:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:42:49.966083 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-1a4180f4-b357-4a39-aa9e-e68e5d11a580 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:49.990125 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-1a4180f4-b357-4a39-aa9e-e68e5d11a580 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027676 Jun 15 15:42:49.990972 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 9/18] 10.222.0.62 () {64 vars in 1335 bytes} [Wed Jun 15 15:42:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:42:52.166618 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-ebf306e5-952c-426a-998f-2827a89f2285 admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:52.167711 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-ebf306e5-952c-426a-998f-2827a89f2285 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jun 15 15:42:52.168108 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 10/19] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:42:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:42:52.229427 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-d717559e-c088-4ce8-8399-5402c71dbe78 admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:52.254179 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-d717559e-c088-4ce8-8399-5402c71dbe78 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080226 Jun 15 15:42:52.254754 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 10/20] 10.222.0.62 () {60 vars in 1291 bytes} [Wed Jun 15 15:42:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:42:54.454480 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-ebf306e5-952c-426a-998f-2827a89f2285 admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:54.455538 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-ebf306e5-952c-426a-998f-2827a89f2285 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 15 15:42:54.455942 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 11/21] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:42:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:42:54.519843 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-499deac4-f9f7-46ae-97d0-b032d3f028f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "id": "1"}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:54.541257 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-499deac4-f9f7-46ae-97d0-b032d3f028f1 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079445 Jun 15 15:42:54.541949 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 11/22] 10.222.0.62 () {64 vars in 1282 bytes} [Wed Jun 15 15:42:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:42:54.555142 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-cfec1b70-69ac-4dfb-8a8a-4f31f733ccd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:54.582127 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-cfec1b70-69ac-4dfb-8a8a-4f31f733ccd2 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031527 Jun 15 15:42:54.582883 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 12/23] 10.222.0.62 () {64 vars in 1332 bytes} [Wed Jun 15 15:42:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:42:56.785562 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-499deac4-f9f7-46ae-97d0-b032d3f028f1 admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:56.786624 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-499deac4-f9f7-46ae-97d0-b032d3f028f1 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jun 15 15:42:56.787072 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 12/24] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:42:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:42:56.847749 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-f2dbbd0c-a020-403a-a769-d08e28528d37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20}} {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:56.865137 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-f2dbbd0c-a020-403a-a769-d08e28528d37 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071984 Jun 15 15:42:56.865713 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 13/25] 10.222.0.62 () {64 vars in 1282 bytes} [Wed Jun 15 15:42:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:42:56.879986 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-d547b074-3213-47fc-8c0d-d523852fcecc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:56.903637 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-d547b074-3213-47fc-8c0d-d523852fcecc admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029487 Jun 15 15:42:56.904222 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 13/26] 10.222.0.62 () {64 vars in 1332 bytes} [Wed Jun 15 15:42:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:42:59.096308 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-f2dbbd0c-a020-403a-a769-d08e28528d37 admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:42:59.097270 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-f2dbbd0c-a020-403a-a769-d08e28528d37 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 15 15:42:59.097674 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 14/27] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:42:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:42:59.161694 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-ec7c09cc-ba62-44dc-9889-5d1931e2f9fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "vcpus": 2}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:59.184530 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-ec7c09cc-ba62-44dc-9889-5d1931e2f9fd admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.080463 Jun 15 15:42:59.185431 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 14/28] 10.222.0.62 () {64 vars in 1282 bytes} [Wed Jun 15 15:42:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 15:42:59.201296 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-c9ec4819-9984-4956-aa34-f1a0598af245 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:42:59.230478 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-c9ec4819-9984-4956-aa34-f1a0598af245 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034345 Jun 15 15:42:59.232129 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 15/29] 10.222.0.62 () {64 vars in 1332 bytes} [Wed Jun 15 15:42:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:43:01.386233 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-ec7c09cc-ba62-44dc-9889-5d1931e2f9fd admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:01.387340 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-ec7c09cc-ba62-44dc-9889-5d1931e2f9fd admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jun 15 15:43:01.387737 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 15/30] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:43:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:43:01.447211 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-c1b877f3-cac0-4693-92c3-1cac4067c46c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "id": "4", "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:43:01.465756 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-c1b877f3-cac0-4693-92c3-1cac4067c46c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071585 Jun 15 15:43:01.466432 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 16/31] 10.222.0.62 () {64 vars in 1282 bytes} [Wed Jun 15 15:43:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:43:01.477817 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-22348473-f201-456a-af8d-cf7cb040a582 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:43:01.500407 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-22348473-f201-456a-af8d-cf7cb040a582 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026162 Jun 15 15:43:01.500979 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 16/32] 10.222.0.62 () {64 vars in 1332 bytes} [Wed Jun 15 15:43:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:43:03.690355 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-c1b877f3-cac0-4693-92c3-1cac4067c46c admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:03.691464 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-c1b877f3-cac0-4693-92c3-1cac4067c46c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jun 15 15:43:03.692098 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 17/33] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:43:03.754373 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-83d61c0a-d010-4cbc-9c0c-6faa74e67d6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "swap": 0, "id": "5", "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:43:03.772795 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-83d61c0a-d010-4cbc-9c0c-6faa74e67d6c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074843 Jun 15 15:43:03.773348 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 17/34] 10.222.0.62 () {64 vars in 1282 bytes} [Wed Jun 15 15:43:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 15:43:03.785204 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-8c9939ae-2fdf-42f0-ab18-e4aca4e32256 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:43:03.807629 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-8c9939ae-2fdf-42f0-ab18-e4aca4e32256 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025993 Jun 15 15:43:03.808954 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 18/35] 10.222.0.62 () {64 vars in 1332 bytes} [Wed Jun 15 15:43:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:43:27.867441 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-83d61c0a-d010-4cbc-9c0c-6faa74e67d6c admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:27.868488 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-83d61c0a-d010-4cbc-9c0c-6faa74e67d6c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jun 15 15:43:27.868887 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 18/36] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:43:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:43:27.879441 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG dbcounter [-] [109583] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:43:27.928536 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-02e0e371-696d-438d-9708-781fa876a9c4 admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:27.945254 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-02e0e371-696d-438d-9708-781fa876a9c4 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070381 Jun 15 15:43:27.945794 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 19/37] 10.222.0.62 () {60 vars in 1291 bytes} [Wed Jun 15 15:43:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:43:28.902144 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-83d61c0a-d010-4cbc-9c0c-6faa74e67d6c admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:28.903186 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-83d61c0a-d010-4cbc-9c0c-6faa74e67d6c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 15 15:43:28.903580 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 19/38] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:43:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:43:29.103859 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-3b25e081-6929-4d4b-89b5-1208e04f5938 admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:29.109316 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.wsgi [None req-3b25e081-6929-4d4b-89b5-1208e04f5938 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-3b25e081-6929-4d4b-89b5-1208e04f5938 admin admin] Request method failure captured: Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Accept: application/json Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Accept-Encoding: gzip, deflate Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Connection: keep-alive Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Content-Length: 0 Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Host: 10.222.0.62 Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Openstack-Api-Version: compute 2.90 Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Openstack-System-Scope: None Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: User-Agent: python-novaclient Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Auth-Token: gAAAAABiqf4gkHPcymK3pySiJMwL5_QFJjY2NoEMIc7VhqnvsacW2UcTINCDBWjXQuAWiBT4lAyfnhrZqHdgxNGA3cBZeudYO1MSBIIZ7W-e3vWHC7HHf3cT8B6WvCPNdbYDi7d3EMH-YMbYagaHSBVOwpGeaJJoQiCr6ihLSaAMFBPKMlYeplY Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Domain-Id: None Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Domain-Name: None Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Identity-Status: Confirmed Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Is-Admin-Project: True Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Domain-Id: default Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Domain-Name: Default Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Name: admin Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Role: admin,member,reader Jun 15 15:43:29.113085 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Roles: admin,member,reader Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_87109ec03f124710b1afe403b1e173c0", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Tenant: admin Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Tenant-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Tenant-Name: admin Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User: admin Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Domain-Id: default Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Domain-Name: Default Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Id: 38729f2fb8864984b35336009a142811 Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Name: admin Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: method: > Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: exception: Flavor 42 could not be found. Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: action_args: {'id': '42'} Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:43:29.114832 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:29.115755 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:29.116944 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-3b25e081-6929-4d4b-89b5-1208e04f5938 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:43:29.118098 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-3b25e081-6929-4d4b-89b5-1208e04f5938 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062142 Jun 15 15:43:29.118098 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 20/39] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Jun 15 15:43:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 15:43:29.124123 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-8b84e52b-4146-43de-9e00-8b587bd86694 admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:29.127689 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:43:29.146603 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-8b84e52b-4146-43de-9e00-8b587bd86694 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025979 Jun 15 15:43:29.147160 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 20/40] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Jun 15 15:43:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:43:29.157556 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-4cbe7509-d540-45eb-b8c7-e283b05e8d27 admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:29.179267 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-4cbe7509-d540-45eb-b8c7-e283b05e8d27 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025975 Jun 15 15:43:29.179822 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 21/41] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Jun 15 15:43:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:43:29.189417 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-e144856f-87d9-4855-9875-5b08f7dd1333 admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:29.196414 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.wsgi [None req-e144856f-87d9-4855-9875-5b08f7dd1333 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-e144856f-87d9-4855-9875-5b08f7dd1333 admin admin] Request method failure captured: Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Accept: application/json Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Accept-Encoding: gzip, deflate Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Connection: keep-alive Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Content-Length: 0 Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Host: 10.222.0.62 Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Openstack-Api-Version: compute 2.90 Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Openstack-System-Scope: None Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: User-Agent: python-novaclient Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Auth-Token: gAAAAABiqf4gkHPcymK3pySiJMwL5_QFJjY2NoEMIc7VhqnvsacW2UcTINCDBWjXQuAWiBT4lAyfnhrZqHdgxNGA3cBZeudYO1MSBIIZ7W-e3vWHC7HHf3cT8B6WvCPNdbYDi7d3EMH-YMbYagaHSBVOwpGeaJJoQiCr6ihLSaAMFBPKMlYeplY Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Domain-Id: None Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Domain-Name: None Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Identity-Status: Confirmed Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Is-Admin-Project: True Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Domain-Id: default Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Domain-Name: Default Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Name: admin Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Role: admin,member,reader Jun 15 15:43:29.199667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Roles: admin,member,reader Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_87109ec03f124710b1afe403b1e173c0", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Tenant: admin Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Tenant-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Tenant-Name: admin Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User: admin Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Domain-Id: default Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Domain-Name: Default Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Id: 38729f2fb8864984b35336009a142811 Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Name: admin Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: method: > Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: exception: Flavor 42 could not be found. Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: action_args: {'id': '42'} Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:43:29.201212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:29.202174 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:29.203534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-e144856f-87d9-4855-9875-5b08f7dd1333 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:43:29.204726 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-e144856f-87d9-4855-9875-5b08f7dd1333 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015311 Jun 15 15:43:29.204726 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 21/42] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Jun 15 15:43:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 15:43:30.052107 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-4cbe7509-d540-45eb-b8c7-e283b05e8d27 admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:30.053120 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-4cbe7509-d540-45eb-b8c7-e283b05e8d27 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 15 15:43:30.053511 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 22/43] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:43:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:43:30.249088 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-66d45807-e858-446b-971b-61f16e5b2cbb admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:30.255601 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.wsgi [None req-66d45807-e858-446b-971b-61f16e5b2cbb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-66d45807-e858-446b-971b-61f16e5b2cbb admin admin] Request method failure captured: Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Accept: application/json Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Accept-Encoding: gzip, deflate Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Connection: keep-alive Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Content-Length: 0 Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Host: 10.222.0.62 Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Openstack-Api-Version: compute 2.90 Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Openstack-System-Scope: None Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: User-Agent: python-novaclient Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Auth-Token: gAAAAABiqf4irEiudOed4C2xpHlGuFMZV1WO-5Sw7bdLGogl0-4VpR4LfFb_cPdTiqb4D86cEUdcke6Xuq3xOwM_pGvxtwe9x0Fxlsh_9Wnq7BoKhELQBccIuIqWM6r_jyNKugi_FrztvVhcPB4QU9qpJKpirOcimsk1Sem6sOVFZD4195LX8wI Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Domain-Id: None Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Domain-Name: None Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Identity-Status: Confirmed Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Is-Admin-Project: True Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Domain-Id: default Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Domain-Name: Default Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Name: admin Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Role: admin,member,reader Jun 15 15:43:30.257169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Roles: admin,member,reader Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_87109ec03f124710b1afe403b1e173c0", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Tenant: admin Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Tenant-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Tenant-Name: admin Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User: admin Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Domain-Id: default Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Domain-Name: Default Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Id: 38729f2fb8864984b35336009a142811 Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Name: admin Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: method: > Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: exception: Flavor 84 could not be found. Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: action_args: {'id': '84'} Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:43:30.258716 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:30.260036 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:30.261399 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-66d45807-e858-446b-971b-61f16e5b2cbb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:43:30.262720 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-66d45807-e858-446b-971b-61f16e5b2cbb admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061951 Jun 15 15:43:30.262720 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 22/44] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Jun 15 15:43:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 15:43:30.268997 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-85710572-486a-4dd3-adc1-a3d3d7ec1469 admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:30.282623 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-85710572-486a-4dd3-adc1-a3d3d7ec1469 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017900 Jun 15 15:43:30.283179 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 23/45] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Jun 15 15:43:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:43:30.292065 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-16216a76-e5b9-48ba-b190-efa831d1f6eb admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:30.305881 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-16216a76-e5b9-48ba-b190-efa831d1f6eb admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017227 Jun 15 15:43:30.306395 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 23/46] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Jun 15 15:43:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:43:30.315670 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-07a34f8d-db2e-4279-809c-e949e8dc0bc2 admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:30.320817 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.wsgi [None req-07a34f8d-db2e-4279-809c-e949e8dc0bc2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-07a34f8d-db2e-4279-809c-e949e8dc0bc2 admin admin] Request method failure captured: Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Accept: application/json Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Accept-Encoding: gzip, deflate Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Connection: keep-alive Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Content-Length: 0 Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Host: 10.222.0.62 Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Openstack-Api-Version: compute 2.90 Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Openstack-System-Scope: None Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: User-Agent: python-novaclient Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Auth-Token: gAAAAABiqf4irEiudOed4C2xpHlGuFMZV1WO-5Sw7bdLGogl0-4VpR4LfFb_cPdTiqb4D86cEUdcke6Xuq3xOwM_pGvxtwe9x0Fxlsh_9Wnq7BoKhELQBccIuIqWM6r_jyNKugi_FrztvVhcPB4QU9qpJKpirOcimsk1Sem6sOVFZD4195LX8wI Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Domain-Id: None Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Domain-Name: None Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Identity-Status: Confirmed Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Is-Admin-Project: True Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Domain-Id: default Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Domain-Name: Default Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Name: admin Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Role: admin,member,reader Jun 15 15:43:30.322297 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Roles: admin,member,reader Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_87109ec03f124710b1afe403b1e173c0", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Tenant: admin Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Tenant-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Tenant-Name: admin Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User: admin Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Domain-Id: default Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Domain-Name: Default Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Id: 38729f2fb8864984b35336009a142811 Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Name: admin Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: method: > Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: exception: Flavor 84 could not be found. Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: action_args: {'id': '84'} Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:43:30.323890 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:30.324721 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:30.326062 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-07a34f8d-db2e-4279-809c-e949e8dc0bc2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:43:30.327336 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-07a34f8d-db2e-4279-809c-e949e8dc0bc2 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011986 Jun 15 15:43:30.327336 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 24/47] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Jun 15 15:43:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 15 15:43:31.198123 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-16216a76-e5b9-48ba-b190-efa831d1f6eb admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:31.199150 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-16216a76-e5b9-48ba-b190-efa831d1f6eb admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 15 15:43:31.199534 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 24/48] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:43:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:43:31.385927 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-6c93f01a-4ed7-4730-ac3e-05f883cbc67f admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:31.392881 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.wsgi [None req-6c93f01a-4ed7-4730-ac3e-05f883cbc67f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-6c93f01a-4ed7-4730-ac3e-05f883cbc67f admin admin] Request method failure captured: Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Accept: application/json Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Accept-Encoding: gzip, deflate Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Connection: keep-alive Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Content-Length: 0 Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Host: 10.222.0.62 Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Openstack-Api-Version: compute 2.90 Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Openstack-System-Scope: None Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: User-Agent: python-novaclient Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Auth-Token: gAAAAABiqf4jrovJ7WqIV9d1CrIRw3NZYIjkHJ4xQ6IVkvRVLN-e_Ay42uFqKr6fYdavYcA4jj8kZWX2eiqqc6vd8d1DH1C6WcodiZWsvO_zBLZ-O9koIqfOUw73SccmxeIZPZ_6nMm9JwFcdPs8FZs15FYlgO9q1qdaTZ6LLqDpzUCEJE3Bn-I Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Domain-Id: None Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Domain-Name: None Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Identity-Status: Confirmed Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Is-Admin-Project: True Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Domain-Id: default Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Domain-Name: Default Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Project-Name: admin Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Role: admin,member,reader Jun 15 15:43:31.394366 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Roles: admin,member,reader Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_87109ec03f124710b1afe403b1e173c0", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Tenant: admin Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Tenant-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-Tenant-Name: admin Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User: admin Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Domain-Id: default Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Domain-Name: Default Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Id: 38729f2fb8864984b35336009a142811 Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: X-User-Name: admin Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: method: > Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: exception: Flavor 451 could not be found. Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: action_args: {'id': '451'} Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:43:31.395730 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:31.396541 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: ERROR nova.api.openstack.wsgi Jun 15 15:43:31.397561 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-6c93f01a-4ed7-4730-ac3e-05f883cbc67f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:43:31.398798 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-6c93f01a-4ed7-4730-ac3e-05f883cbc67f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060955 Jun 15 15:43:31.398798 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 25/49] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Jun 15 15:43:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 15:43:31.405169 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-e3fa1b5d-95a1-435f-a04f-a5ff5e87f604 admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:31.420202 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-e3fa1b5d-95a1-435f-a04f-a5ff5e87f604 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018617 Jun 15 15:43:31.420708 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 25/50] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Jun 15 15:43:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:43:31.430307 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:31.444158 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017311 Jun 15 15:43:31.444699 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 26/51] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Jun 15 15:43:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:43:31.453871 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-180bdc92-98fb-4248-8456-403148f56e40 admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:31.459212 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.wsgi [None req-180bdc92-98fb-4248-8456-403148f56e40 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-180bdc92-98fb-4248-8456-403148f56e40 admin admin] Request method failure captured: Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Accept: application/json Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Accept-Encoding: gzip, deflate Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Connection: keep-alive Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Content-Length: 0 Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Host: 10.222.0.62 Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Openstack-Api-Version: compute 2.90 Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Openstack-System-Scope: None Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: User-Agent: python-novaclient Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Auth-Token: gAAAAABiqf4jrovJ7WqIV9d1CrIRw3NZYIjkHJ4xQ6IVkvRVLN-e_Ay42uFqKr6fYdavYcA4jj8kZWX2eiqqc6vd8d1DH1C6WcodiZWsvO_zBLZ-O9koIqfOUw73SccmxeIZPZ_6nMm9JwFcdPs8FZs15FYlgO9q1qdaTZ6LLqDpzUCEJE3Bn-I Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Domain-Id: None Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Domain-Name: None Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Identity-Status: Confirmed Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Is-Admin-Project: True Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Openstack-Nova-Api-Version: 2.90 Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Domain-Id: default Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Domain-Name: Default Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Project-Name: admin Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Role: admin,member,reader Jun 15 15:43:31.460687 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Roles: admin,member,reader Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/87109ec03f124710b1afe403b1e173c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_87109ec03f124710b1afe403b1e173c0", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Tenant: admin Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Tenant-Id: 87109ec03f124710b1afe403b1e173c0 Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-Tenant-Name: admin Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User: admin Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Domain-Id: default Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Domain-Name: Default Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Id: 38729f2fb8864984b35336009a142811 Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: X-User-Name: admin Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: method: > Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: exception: Flavor 451 could not be found. Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: action_args: {'id': '451'} Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:43:31.462165 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:31.463108 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: ERROR nova.api.openstack.wsgi Jun 15 15:43:31.464384 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-180bdc92-98fb-4248-8456-403148f56e40 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109584) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:43:31.465835 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-180bdc92-98fb-4248-8456-403148f56e40 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011724 Jun 15 15:43:31.465835 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 26/52] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Jun 15 15:43:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 15 15:43:32.336530 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:32.337537 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 15 15:43:32.337930 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 27/53] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:43:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:43:32.524410 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-6f7c590a-b9e1-4329-b194-8d4cdc897912 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:43:32.542890 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-6f7c590a-b9e1-4329-b194-8d4cdc897912 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069954 Jun 15 15:43:32.543424 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 27/54] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Jun 15 15:43:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:43:33.416799 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:33.417817 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 15 15:43:33.418200 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 28/55] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:43:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:43:33.622386 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-7dc89cd1-c59a-41d8-8649-4219c54c115b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:43:33.639244 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-7dc89cd1-c59a-41d8-8649-4219c54c115b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068134 Jun 15 15:43:33.639730 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 28/56] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Jun 15 15:43:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:43:34.501617 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:34.502623 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 15 15:43:34.503047 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 29/57] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:43:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:43:34.690193 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-ae0ca387-1c6d-4083-9146-1b7576c24648 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:43:34.707195 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-ae0ca387-1c6d-4083-9146-1b7576c24648 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068480 Jun 15 15:43:34.707668 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 29/58] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Jun 15 15:43:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:43:35.563046 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:35.564616 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Jun 15 15:43:35.565005 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 30/59] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:43:35.753782 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-af130046-c4dc-4c04-a4a0-0f48f01c4f7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:43:35.771421 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-af130046-c4dc-4c04-a4a0-0f48f01c4f7c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068712 Jun 15 15:43:35.771946 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 30/60] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Jun 15 15:43:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:43:36.622376 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:36.623411 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 15 15:43:36.623801 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 31/61] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:43:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:43:36.810830 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-50fb2045-a896-4ab1-a044-c05029dc86d8 admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:43:36.830692 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-50fb2045-a896-4ab1-a044-c05029dc86d8 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070470 Jun 15 15:43:36.831242 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 31/62] 10.222.0.62 () {60 vars in 1202 bytes} [Wed Jun 15 15:43:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:44:24.572856 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:44:24.573889 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-c512b698-6e7a-4b8a-b4f0-a3adc3f87c8a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 15 15:44:24.574278 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 32/63] 10.222.0.62 () {54 vars in 930 bytes} [Wed Jun 15 15:44:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:44:24.584375 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:44:24.632345 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-c8341827-7bb0-4d0e-b587-5e2816b7ac8a admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:44:24.651335 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-c8341827-7bb0-4d0e-b587-5e2816b7ac8a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071442 Jun 15 15:44:24.651862 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 32/64] 10.222.0.62 () {60 vars in 1291 bytes} [Wed Jun 15 15:44:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:44:24.674630 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-f392bd24-da6c-4930-a300-9605c961b931 admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:44:24.678119 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG dbcounter [-] [109583] Writing DB stats nova_api:SELECT=14 {{(pid=109583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:44:24.684031 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-f392bd24-da6c-4930-a300-9605c961b931 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013046 Jun 15 15:44:24.684554 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 33/65] 10.222.0.62 () {60 vars in 1282 bytes} [Wed Jun 15 15:44:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:44:24.695920 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-2d4c0dbc-1c17-420f-928d-61074e2857ed admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:44:24.703441 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-2d4c0dbc-1c17-420f-928d-61074e2857ed admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011050 Jun 15 15:44:24.703902 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 33/66] 10.222.0.62 () {60 vars in 1285 bytes} [Wed Jun 15 15:44:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:44:24.714815 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-629b672b-bc37-4543-8403-c221665363ce admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:44:24.722259 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-629b672b-bc37-4543-8403-c221665363ce admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010923 Jun 15 15:44:24.722788 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 34/67] 10.222.0.62 () {60 vars in 1285 bytes} [Wed Jun 15 15:44:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:44:24.734184 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-795ebfcc-fa1e-4424-9d1f-c7e4ab718f20 admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:44:24.742181 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-795ebfcc-fa1e-4424-9d1f-c7e4ab718f20 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011411 Jun 15 15:44:24.742686 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 34/68] 10.222.0.62 () {60 vars in 1282 bytes} [Wed Jun 15 15:44:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:47:50.470634 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-629b672b-bc37-4543-8403-c221665363ce admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:47:50.471687 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-629b672b-bc37-4543-8403-c221665363ce admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 15 15:47:50.472079 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 35/69] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:47:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:47:50.634272 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writing DB stats nova_api:SELECT=6 {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:47:50.747667 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-80e01d3f-911e-4945-b886-94cc50eff914 admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:47:50.748842 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 15:47:50.748842 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: warnings.warn(msg) Jun 15 15:47:50.750071 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-80e01d3f-911e-4945-b886-94cc50eff914 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:47:50.750513 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-80e01d3f-911e-4945-b886-94cc50eff914 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:47:50.751331 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-80e01d3f-911e-4945-b886-94cc50eff914 admin admin] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:47:50.751764 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-80e01d3f-911e-4945-b886-94cc50eff914 admin admin] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:47:50.786149 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-80e01d3f-911e-4945-b886-94cc50eff914 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153277 Jun 15 15:47:50.786689 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 35/70] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Jun 15 15:47:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:47:51.651158 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-629b672b-bc37-4543-8403-c221665363ce admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:47:51.652169 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-629b672b-bc37-4543-8403-c221665363ce admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 15 15:47:51.652554 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 36/71] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:47:51.843039 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-f905b7fe-3b60-4013-9808-95c0122e27b6 admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:47:51.844238 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 15:47:51.844238 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: warnings.warn(msg) Jun 15 15:47:51.845484 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-f905b7fe-3b60-4013-9808-95c0122e27b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:47:51.845925 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-f905b7fe-3b60-4013-9808-95c0122e27b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:47:51.846720 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-f905b7fe-3b60-4013-9808-95c0122e27b6 admin admin] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:47:51.847168 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-f905b7fe-3b60-4013-9808-95c0122e27b6 admin admin] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:47:51.866751 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-f905b7fe-3b60-4013-9808-95c0122e27b6 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075283 Jun 15 15:47:51.867311 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 36/72] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Jun 15 15:47:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:48:03.167997 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-629b672b-bc37-4543-8403-c221665363ce admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:48:03.169006 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-629b672b-bc37-4543-8403-c221665363ce admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 15 15:48:03.169402 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 37/73] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:48:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:48:03.315888 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writing DB stats nova_cell0:SELECT=4 {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:48:03.316517 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writing DB stats nova_cell1:SELECT=4 {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:48:03.317308 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG dbcounter [-] [109584] Writing DB stats nova_api:SELECT=8 {{(pid=109584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:48:03.361279 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-2a3084bc-6fb3-4226-9ef3-63e4a2ae349d admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:48:03.362448 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 15:48:03.362448 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: warnings.warn(msg) Jun 15 15:48:03.363654 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-2a3084bc-6fb3-4226-9ef3-63e4a2ae349d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:48:03.364091 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-2a3084bc-6fb3-4226-9ef3-63e4a2ae349d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:48:03.364864 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-2a3084bc-6fb3-4226-9ef3-63e4a2ae349d admin admin] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:48:03.365290 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-2a3084bc-6fb3-4226-9ef3-63e4a2ae349d admin admin] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:48:03.389806 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-2a3084bc-6fb3-4226-9ef3-63e4a2ae349d admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079203 Jun 15 15:48:03.390336 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 37/74] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Jun 15 15:48:03 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:48:04.269601 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: DEBUG nova.api.openstack.wsgi [None req-629b672b-bc37-4543-8403-c221665363ce admin admin] Calling method '>' {{(pid=109583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:48:04.270681 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: INFO nova.api.openstack.requestlog [None req-629b672b-bc37-4543-8403-c221665363ce admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 15 15:48:04.271195 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: [pid: 109583|app: 0|req: 38/75] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Jun 15 15:48:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:48:04.465898 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG nova.api.openstack.wsgi [None req-0b1e9958-76ee-44ed-abca-42c518d46a0e admin admin] Calling method '>' {{(pid=109584) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:48:04.467723 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 15:48:04.467723 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: warnings.warn(msg) Jun 15 15:48:04.468973 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-0b1e9958-76ee-44ed-abca-42c518d46a0e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:48:04.469414 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-0b1e9958-76ee-44ed-abca-42c518d46a0e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:48:04.470206 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-0b1e9958-76ee-44ed-abca-42c518d46a0e admin admin] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:48:04.470627 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: DEBUG oslo_concurrency.lockutils [None req-0b1e9958-76ee-44ed-abca-42c518d46a0e admin admin] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109584) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:48:04.492452 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: INFO nova.api.openstack.requestlog [None req-0b1e9958-76ee-44ed-abca-42c518d46a0e admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079863 Jun 15 15:48:04.492932 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: [pid: 109584|app: 0|req: 38/76] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Jun 15 15:48:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:49:03.611456 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: Wed Jun 15 15:49:03 2022 - graceful shutdown triggered... Jun 15 15:49:03.611209 dv-cinder-845990-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 15 15:49:03.612445 dv-cinder-845990-1-iscsi devstack@n-api.service[109583]: Gracefully killing worker 1 (pid: 109583)... Jun 15 15:49:03.613073 dv-cinder-845990-1-iscsi devstack@n-api.service[109584]: Gracefully killing worker 2 (pid: 109584)... Jun 15 15:49:04.612210 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: worker 1 buried after 1 seconds Jun 15 15:49:04.612210 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: worker 2 buried after 1 seconds Jun 15 15:49:04.612210 dv-cinder-845990-1-iscsi devstack@n-api.service[109582]: goodbye to uWSGI. Jun 15 15:49:04.613781 dv-cinder-845990-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 15 15:49:04.614336 dv-cinder-845990-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 15 15:49:04.617073 dv-cinder-845990-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 15 15:49:04.631837 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 15 15:49:04.633848 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 15:49:04 2022] *** Jun 15 15:49:04.633848 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 15:49:04.633848 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 15:49:04.633848 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: nodename: dv-cinder-845990-1-iscsi Jun 15 15:49:04.633848 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: machine: x86_64 Jun 15 15:49:04.633848 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: clock source: unix Jun 15 15:49:04.633848 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: pcre jit disabled Jun 15 15:49:04.633848 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: detected number of CPU cores: 4 Jun 15 15:49:04.633848 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: current working directory: / Jun 15 15:49:04.633848 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: detected binary path: /usr/bin/uwsgi-core Jun 15 15:49:04.634604 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: your processes number limit is 47680 Jun 15 15:49:04.634604 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: your memory page size is 4096 bytes Jun 15 15:49:04.634604 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: detected max file descriptor number: 2048 Jun 15 15:49:04.634604 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: lock engine: pthread robust mutexes Jun 15 15:49:04.634604 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: thunder lock: enabled Jun 15 15:49:04.634604 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 15 15:49:04.634604 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 15:49:04.679338 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: Python main interpreter initialized at 0x5652bb0f79c0 Jun 15 15:49:04.679338 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: python threads support enabled Jun 15 15:49:04.679338 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: your server socket listen backlog is limited to 100 connections Jun 15 15:49:04.679338 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: your mercy for graceful operations on workers is 90 seconds Jun 15 15:49:04.679753 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 15:49:04.679753 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: *** Operational MODE: preforking *** Jun 15 15:49:04.680058 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: *** uWSGI is running in multiple interpreter mode *** Jun 15 15:49:04.680058 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: spawned uWSGI master process (pid: 123917) Jun 15 15:49:04.680341 dv-cinder-845990-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 15 15:49:04.683188 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: spawned uWSGI worker 1 (pid: 123934, cores: 1) Jun 15 15:49:04.683188 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: spawned uWSGI worker 2 (pid: 123935, cores: 1) Jun 15 15:49:04.691928 dv-cinder-845990-1-iscsi devstack@n-api.service[123917]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 15:49:05.339892 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 15:49:05.348569 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 15 15:49:06.600538 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 15:49:06.600538 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: from cryptography.utils import int_from_bytes Jun 15 15:49:06.601134 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 15:49:06.601134 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: from cryptography.utils import int_from_bytes Jun 15 15:49:06.626585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 15:49:06.626585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: from cryptography.utils import int_from_bytes Jun 15 15:49:06.627282 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 15:49:06.627282 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: from cryptography.utils import int_from_bytes Jun 15 15:49:09.036900 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 15:49:09.037441 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 15:49:09.037693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 15:49:09.038061 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 15:49:09.038319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 15:49:09.038710 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.039074 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.039397 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.054928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.054928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.054928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.054928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.054928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.054928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.054928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.054928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.055608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-1-iscsi {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.055608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.055608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.055608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.055608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.055608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.055608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.055608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-1-iscsi {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.056526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.057707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.058246 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.058246 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.058392 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.058589 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.059114 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.059687 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.060744 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.061243 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.061785 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.062333 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.063640 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.064614 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.065140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.065693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.066211 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.066766 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.067288 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.067816 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.068370 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.068914 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.069454 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.069982 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.070514 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.071181 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.071666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.072205 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.072790 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.073322 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.073839 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.074383 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.074949 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.075471 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.076001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.076527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.076830 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 15:49:09.077264 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 15:49:09.077616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 15:49:09.077981 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 15:49:09.078188 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.078332 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 15:49:09.078645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.078998 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.079323 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.079527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.079629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.079955 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.080274 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.080570 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.080680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.080903 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.081233 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.081493 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.081760 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.081878 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.082117 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-1-iscsi {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.082438 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.082757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.083005 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.083108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.083384 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.083690 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.084013 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.084237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.084348 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.084822 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.085118 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.085229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.085428 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.085740 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.086078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.086341 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.086442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.086753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.087082 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.087388 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.087598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.087708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.088009 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.088415 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-1-iscsi {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.088519 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.088729 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.089042 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.089356 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.089635 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.089766 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.090232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.090442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.090776 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.091131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.091284 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.091708 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.091916 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.092208 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.092575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.092702 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.093096 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.093310 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.093593 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.093994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.094109 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.094520 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.094742 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.095071 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.095404 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.095551 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.095966 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.096190 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.096460 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.096797 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.096920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.097346 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.097532 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.097845 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.098171 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.098343 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.098796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.098942 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.099285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.099569 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.099773 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.100197 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.100327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.100679 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.100854 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.101167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.101483 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.101678 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.102082 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.102279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.102573 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.102948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.103058 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.103476 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.103689 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.103971 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.104299 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.104447 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.104843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.104962 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.105341 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.105591 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.105829 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.106227 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.106346 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.106708 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.106971 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.107264 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.107643 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.107790 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.108136 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.108409 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.108641 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.109055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.109164 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.110052 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.110306 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.110575 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.110964 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.111161 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.111580 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.111769 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.112105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.112376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.112619 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.113018 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.113139 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.113553 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.113741 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.114055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.114386 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.114539 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.114981 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.115184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.115488 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.115819 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.115984 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.116399 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.116693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.116890 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.117249 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.117359 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.117790 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.117957 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.118298 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.118610 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.118811 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.119230 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.119433 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.119742 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.120063 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.120224 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.120641 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.120839 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.121800 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.121890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.121965 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.122378 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.122872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.123162 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.123273 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.123529 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.123715 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.123855 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.124203 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.124599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.124712 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.125167 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.125371 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.126003 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.126232 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.126503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.126622 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.127002 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.127113 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.127290 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.127446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.127791 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.128091 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.128207 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.128449 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.128779 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.129058 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.129174 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.129404 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.129720 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.130035 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.130170 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.130352 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.130468 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.130681 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.130820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.131032 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.131355 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.131675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.131878 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.131987 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.132299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.132533 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.132633 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.132863 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.132987 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.133158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.133282 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.133503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.133811 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.134051 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.134174 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.134384 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.134485 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.134711 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.134834 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.135060 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.135200 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.135421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.135738 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.135859 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.136051 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.136172 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.136457 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.136629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.136765 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.137086 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.137235 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.137404 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.137735 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.137846 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.138039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.138158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.138357 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.138471 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.138665 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.138888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.139013 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.139138 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.139325 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.139591 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.139704 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.139927 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.140118 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.140239 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.140361 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.140557 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.140843 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.140947 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.141179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.141305 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.141515 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.141600 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.142036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.142181 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.142264 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.142344 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.142556 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.142752 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.142919 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.143070 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.143221 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.143370 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.143543 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.143699 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.143699 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.143988 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.144180 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.144329 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.144479 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.144631 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.144811 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.144966 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.145117 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.145334 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.145507 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.145867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.146017 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.146167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.146317 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.146508 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.146667 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.146856 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.147017 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 15:49:09.147335 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.147487 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.148042 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.148042 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.148380 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.148532 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.148682 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.148864 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.149033 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.149177 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.149443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.149625 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.150696 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.151048 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.151231 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.151460 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.151610 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.151751 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.151920 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.151920 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.152591 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.152742 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.152742 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.153046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.153192 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.153344 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.154522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.154763 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.154936 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.155082 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.155232 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.155486 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.155662 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.155924 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.156183 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.156340 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.156561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.156720 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.156865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.157007 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.157186 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.157336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.157495 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.157640 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.157823 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.157971 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.158126 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.158268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.158424 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.158574 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.158811 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.158962 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.159104 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.159245 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.159410 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.159921 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.160069 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.160210 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.160372 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.160641 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.160804 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.160918 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.161156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.161307 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.161476 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.161703 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.161906 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.162512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.162674 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.162913 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.163102 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.163280 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.163435 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.163585 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.163735 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.163884 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.164027 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.164189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.164189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.164189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.164189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.164189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.164189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.165231 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.165393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.165688 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.165838 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.166107 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.166374 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.166540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.166722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.166954 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.167131 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.167307 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.167495 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.167640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.167782 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.167935 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.168077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.168077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.168077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.168077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.168077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.168077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.168077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.168077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.169237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.169237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.169237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.169237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.169237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.169237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.169237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.170354 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.170511 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.170511 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.170511 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.170511 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.170511 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.171238 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.171358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.171476 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.171587 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.171733 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.172965 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.173176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.173338 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.173490 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.173635 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.173786 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.173938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.173938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.174235 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.174379 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.174529 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.174698 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.174884 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.175073 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.175073 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.175358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.175513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.176568 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.176763 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.176763 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.176763 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.176763 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.177362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.177517 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.177673 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.177833 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.178012 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.178159 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.178316 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.178459 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.178459 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.178780 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.178942 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.179091 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.179242 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.179392 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.179541 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.179693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.179837 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.179986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.180142 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.180293 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.180557 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.180715 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.180715 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.181003 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.181155 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.181304 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.181521 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.181689 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.181832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.182005 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.182239 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.182393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.182535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.182708 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.183212 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.183370 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.183539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.184256 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.184416 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.184567 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.184843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.185001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.185153 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.185303 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.185487 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.185630 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.185801 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.186031 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.186238 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.186462 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.186718 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.186901 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.187059 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.187222 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.187372 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.187514 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.187681 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.187681 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.187992 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.188143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.188809 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.188968 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.189124 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.189274 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.189422 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.189606 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.190353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.190553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.191014 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.191299 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.192521 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.193435 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.193610 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.193779 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.193939 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.194096 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.194284 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.194284 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.194654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.194859 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.195023 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.195215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.195407 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.195564 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.195733 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.195884 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.196049 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.196307 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.196480 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.196753 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.197004 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.197173 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.197330 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.197518 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.197668 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.197816 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.197816 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.198117 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.198266 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.198421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.198571 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.198764 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.198932 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.199091 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.199252 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.199448 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.199610 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.199770 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.199920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.200067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.200224 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.200401 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.201150 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.201326 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.201509 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.201509 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.201814 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.201964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.202112 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.202274 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.202514 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.202656 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.202866 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.202963 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.203048 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.203190 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.203338 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.203705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.203813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.203901 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.203985 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204187 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204257 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204328 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204412 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204486 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204563 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204635 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204775 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.204858 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205006 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205085 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205164 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205243 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205322 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205474 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205552 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205647 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205773 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205773 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205917 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.205994 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.206074 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.206153 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.206225 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.206343 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.206418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.206496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.206568 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.206639 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.206915 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.207034 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.207113 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.207185 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.207417 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.207491 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.207572 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.207645 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.207716 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.207787 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.207857 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.207857 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208329 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208481 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208481 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208695 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208773 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208844 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.208963 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209044 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209208 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209280 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209359 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209430 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209430 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209617 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209697 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209697 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209898 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.209973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.210107 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.210186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.210312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.210402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.210481 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.210552 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.210668 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.210766 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.210844 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.210928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.211008 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.211087 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.211178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.211404 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.211503 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.211577 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.211577 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.211796 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.211869 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.211940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.212025 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.212118 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.212118 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.212247 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.212328 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.212400 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.212501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.212501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.212645 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.214296 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.214598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.214818 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.214818 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.215295 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.215480 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.215480 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.215787 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.215938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.215938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.216243 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.216393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.216393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.216710 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.216891 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.217278 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.217459 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.217709 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.217872 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.218022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.218217 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.218373 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.218522 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.218679 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.218854 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.219042 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.219252 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.219413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.219595 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.219749 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.219905 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.220061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.220221 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.220377 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.220542 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.220698 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.220848 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.221009 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.221158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.221355 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.221610 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.221767 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.221918 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.222088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.222271 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.222433 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.222591 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.222808 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.223049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.223289 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.223441 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.223597 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.223765 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.223916 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.224064 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.224064 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.224592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.224813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.224968 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.225125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.225125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.225459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.225612 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.225769 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.225938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.226096 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.226260 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.226424 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.226573 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.226746 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.226903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.227053 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.227357 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.227519 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.227722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.227971 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.228127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.228291 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.228440 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.228588 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.228737 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.228898 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.229075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.229832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.229994 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.230154 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.230348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.230515 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.230515 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.230900 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.231073 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.231233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.231389 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.231551 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.231802 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.231965 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.232123 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.232281 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.232440 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.232590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.232752 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.232910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.233076 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.233305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.233469 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.233626 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.233776 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.233967 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.234126 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.234282 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.235249 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.235419 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.235571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.235767 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.235923 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.236090 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.236253 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.236410 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.236567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.236716 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.236864 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.237026 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.237176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.237464 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.237620 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.237768 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.237963 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.238215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.238415 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.238577 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.238752 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.238908 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.239067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.239231 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.239381 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.239529 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.239679 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.239859 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.240038 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.240209 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.240360 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.240519 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.240668 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.240816 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.240971 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.241121 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.241269 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.241418 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.241572 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.241729 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.241987 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.242143 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.242294 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.242462 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.242620 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.242788 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.242955 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.243106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.243254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.243254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.243632 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.243828 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.243996 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.244154 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.244309 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.244458 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.244714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.244885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.245041 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.245219 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.245501 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.245657 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.245806 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.246002 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.246157 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.246306 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.246488 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.246641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.246832 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.247013 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.247171 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.247321 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.247609 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.247764 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.248930 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.249109 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.249265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.249415 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.249573 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.249723 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.249880 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.250031 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.250244 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.250912 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.251072 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.251233 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.251396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.251553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.251703 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.251888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.252138 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.252295 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.252455 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.252613 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.252768 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.252933 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.253088 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.253247 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.254074 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.254241 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.254394 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.254575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.254850 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.255323 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.255633 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.255790 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.255939 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.256101 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.256260 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.256428 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.256579 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.257319 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.257720 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.257891 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.258042 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.258199 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.258349 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.258616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.258882 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.259079 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.259266 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.259425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.259617 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.260371 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.260537 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.260698 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.260856 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.261014 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.261014 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.261312 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.261512 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.261667 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.261667 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.261885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.262010 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.262298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.262418 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.262529 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.262647 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.262779 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.263168 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.263330 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.263479 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.263636 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.264692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.264974 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.265156 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.265315 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.265465 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.265988 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.266178 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.266335 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.266532 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.266715 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.266978 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.267148 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.267313 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.267476 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.267649 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.268020 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.268185 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.268354 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.269123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.269286 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.269446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.269446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.269742 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.269742 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.270047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.270253 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.270408 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.270514 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.270641 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.270756 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.270844 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.270935 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271010 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271089 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271169 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271251 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271404 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271630 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271630 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271775 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271853 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.271932 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.272004 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.272074 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.272152 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.272225 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.272311 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.272394 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.272467 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.272467 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.272611 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.272690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.273358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.273358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.273521 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.273604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.273678 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.273764 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.273844 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.273938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.274033 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.274127 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.274211 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.274302 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.274392 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.274476 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.274561 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.274646 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.274766 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.274869 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.274977 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.275063 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.275161 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.275246 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.275337 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.275421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.275511 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.275595 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.275703 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.275703 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.276052 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.276147 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.276231 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.276315 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.276407 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.276500 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.276591 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.276683 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.276768 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.276864 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.276953 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.277026 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.277099 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.277181 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.277272 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.277365 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.277457 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.277541 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.277629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.277719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.277809 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.278128 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.278223 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.278315 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.278400 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.278483 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.278575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.278668 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.278781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.278880 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.278966 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.279056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.279150 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.279235 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.279318 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.279408 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.279492 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.279574 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.279670 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.279754 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.279844 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.279929 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280011 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280102 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280186 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280429 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.280952 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.281036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.281126 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.281217 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.281308 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.281392 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.281500 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.281591 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.281687 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.281779 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.281870 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.281960 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.282044 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.282139 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.282230 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.282314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.282404 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.282495 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.282586 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.282683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.282802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.283061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.283158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.283242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.283357 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.283449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.283530 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.283615 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.283695 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.283900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.284040 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.284132 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.284206 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.284276 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.284363 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.284455 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.284455 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.284900 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.284993 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.285083 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.285167 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.285255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.285353 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.285445 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.285530 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.285612 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.285701 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.285784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.285879 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.286109 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.286216 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.286324 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.286417 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.286501 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.286594 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.286743 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.286832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.286904 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.286987 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.287080 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.287161 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.287250 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.287334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.287423 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.287506 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.287597 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.287681 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.287764 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.287853 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.287936 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.288020 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.288147 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.288236 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.288320 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.288409 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.288492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.288575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.288667 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.288759 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.288842 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.288925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289007 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289102 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289352 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289435 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289523 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289620 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289713 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289804 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.289977 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.290060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.290151 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.290242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.290333 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.290423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.290583 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.290862 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.290975 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.291194 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.291295 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.291515 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.291605 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.291831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.291930 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.292151 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.292241 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.292458 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.292571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.292760 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.292861 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.293073 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.293176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.293376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.293483 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.293684 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.293789 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.294010 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.294311 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.294403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.294615 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.294715 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.294943 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.295047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.295246 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.295570 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.295689 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.295874 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.295987 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.296197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.296304 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.296504 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.296616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.296808 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.296921 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.297677 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.297784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.298002 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.298118 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.298335 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.298433 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.298674 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.299046 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.299367 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.299477 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.299688 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.299796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.300015 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.300116 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.300334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.300439 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.300649 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.300740 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.300972 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.301085 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.301609 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.301724 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.301804 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.301878 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.301949 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.302021 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.302198 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.302352 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.302510 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.302641 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.302842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.302984 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.303160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.303302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.303479 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.303613 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.303796 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.303922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.304111 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.304259 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.304582 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.304693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.304899 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.305015 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.305213 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.305318 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.305529 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.305639 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.305840 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.305954 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.306167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.306283 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.306458 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.306577 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.306810 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.306914 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.307139 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.307446 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.307881 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.308154 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.308269 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.308383 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.308477 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.308712 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.308832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.309029 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.309145 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.309426 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.309524 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.309743 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.309842 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.310061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.310153 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.310543 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.310653 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.310801 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.310893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.311075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.311176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.311380 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.311470 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.311695 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.311800 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.312008 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.312128 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.312322 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.312421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.312631 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.312782 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.313498 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.313627 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.313817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.313930 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.314128 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.314229 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.314438 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.314529 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.314795 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.314892 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.315086 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.315185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.315400 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.315499 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.315720 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.315826 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.316035 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.316148 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.316342 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.316464 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.316640 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.316743 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.316948 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.317040 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.317256 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.317348 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.317564 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.317772 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.317878 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.318093 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.318210 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.318428 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.318527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.318788 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.318892 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.319121 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.319230 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.319439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.319539 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.319741 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.319854 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.320047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.320147 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.320354 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.320453 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.320657 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.320758 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.320960 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.321049 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.321265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.321356 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.321566 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.321657 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.321867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.321957 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.322169 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.322275 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.322475 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.322565 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.322815 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.322923 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.323124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.323226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.323480 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.323655 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.323793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.324005 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.324117 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.324319 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.324412 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.324644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.324736 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.324969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.325061 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.325286 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.325378 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.325593 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.325684 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.325913 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.326012 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.326219 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.326311 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.326525 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.326629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.326859 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.326980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.327168 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.327260 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.327472 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.327558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.327776 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.327877 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.328086 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.328185 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.328420 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.328515 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.328727 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.328825 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.329036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.329126 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.329338 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.329430 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.329661 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.329760 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.329965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.330055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.330275 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.330371 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.330577 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.330669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.330911 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.331005 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.331215 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.331306 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.331517 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.331610 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.331821 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.331917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.332125 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.332215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.332434 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.332526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.332736 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.332827 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.333044 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.333144 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.333347 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.333437 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.333655 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.333744 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.333959 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.334075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.334269 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.334372 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.334619 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.334717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.334959 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.335065 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.335262 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.335354 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.335562 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.335660 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.335874 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.335965 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.336183 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.336275 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.336504 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.336615 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.336748 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123935) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 15:49:09.336846 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.337106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.337449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.337766 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.338296 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.338631 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.338973 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.339305 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.339634 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.339941 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.340253 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.340558 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.340881 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.341192 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.341501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.341812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.342121 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.342430 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.342749 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.343070 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.343381 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.343689 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.344511 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.344822 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.345132 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.345441 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.345755 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.346093 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.346408 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.346789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.347063 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.347377 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.347688 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.347998 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.348304 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.348612 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.348927 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.349253 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.349563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.349865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.350291 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.350602 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.350986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.351309 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.351619 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.351939 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.352263 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.352570 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.352892 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.353202 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.353530 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.353865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.354193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.354516 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.354843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.355150 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.355456 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.355766 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.356082 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.356389 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.356691 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.356996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.357345 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.357607 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.357911 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.358215 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.358519 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.358848 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.359152 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.359454 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.360317 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.360635 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.360941 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.361246 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.361553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.361855 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.362158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.362459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.362866 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.363080 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.363411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.363744 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.364055 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.364376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.364686 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.365005 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.365312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.365632 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.365953 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.366264 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.366577 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.366940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.367237 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.367549 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.367859 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.368167 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.368475 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.368784 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.369109 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.369429 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.369736 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.370060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.370383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.370702 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.371037 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.371348 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.371678 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.371988 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.372295 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.372611 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.372973 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.373224 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.373538 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.373853 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.374179 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.374501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.374844 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.375196 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.375686 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.376041 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.376357 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.376703 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.377049 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.377385 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.377660 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.377967 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 15:49:09.378213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 15:49:09.399552 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO dbcounter [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] Registered counter for database nova_api Jun 15 15:49:09.420092 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123935) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:49:09.427313 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writer thread running {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:49:09.441431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO dbcounter [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] Registered counter for database nova_api Jun 15 15:49:09.462763 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_db.sqlalchemy.engines [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:49:09.469947 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writer thread running {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:49:09.490928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.context [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a7cda08c-8d99-4c22-b02a-df5ced6c50f0(cell1) {{(pid=123935) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 15:49:09.495111 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:49:09.496692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:49:09.497477 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:49:09.499488 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:49:09.501531 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO dbcounter [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] Registered counter for database nova_cell0 Jun 15 15:49:09.505505 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO dbcounter [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] Registered counter for database nova_cell1 Jun 15 15:49:09.513710 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123935) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:49:09.516423 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123935) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:49:09.521147 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writer thread running {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:49:09.531294 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.context [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a7cda08c-8d99-4c22-b02a-df5ced6c50f0(cell1) {{(pid=123934) load_cells /opt/stack/nova/nova/context.py:464}} Jun 15 15:49:09.536269 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:49:09.537824 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:49:09.538609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:49:09.540602 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:49:09.542586 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO dbcounter [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] Registered counter for database nova_cell0 Jun 15 15:49:09.546471 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO dbcounter [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] Registered counter for database nova_cell1 Jun 15 15:49:09.554529 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_db.sqlalchemy.engines [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:49:09.556318 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_db.sqlalchemy.engines [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:49:09.561856 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writer thread running {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:49:09.564524 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writer thread running {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:49:09.660525 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writer thread running {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:49:09.670478 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO dbcounter [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] Registered counter for database nova_cell0 Jun 15 15:49:09.677676 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123935) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:49:09.682007 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writer thread running {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:49:09.711364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO dbcounter [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] Registered counter for database nova_cell0 Jun 15 15:49:09.718195 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_db.sqlalchemy.engines [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 15:49:09.723197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writer thread running {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 15:49:10.007532 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: WARNING keystonemiddleware.auth_token [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 15:49:10.014719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: WARNING keystonemiddleware.auth_token [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 15:49:10.046829 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: WARNING keystonemiddleware.auth_token [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 15:49:10.054103 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: WARNING keystonemiddleware.auth_token [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 15:49:10.362212 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: WARNING keystonemiddleware.auth_token [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 15:49:10.368139 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: WARNING keystonemiddleware.auth_token [None req-0fb201a6-06c0-4704-aa0f-60a7c96af6fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 15:49:10.373496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5652bb0f79c0 pid: 123935 (default app) Jun 15 15:49:10.397277 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: WARNING keystonemiddleware.auth_token [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 15 15:49:10.403251 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: WARNING keystonemiddleware.auth_token [None req-d4c37f4a-2f36-4969-bebd-480fe569fa47 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 15 15:49:10.408607 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5652bb0f79c0 pid: 123934 (default app) Jun 15 15:49:50.740975 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:49:50.743400 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:49:50.746119 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:49:50.748484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:49:52.842697 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-722d8f7a-c91c-4828-9b74-25328cb7640d tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] Action: 'create', calling method: .version_select at 0x7fd8d994f790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1277770434", "metadata": {"Type": "work"}}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:49:53.552617 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=3 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:49:53.554229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=3 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:49:53.557581 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=3 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:49:53.558653 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=3 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:49:54.759302 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-596682535", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "networks": [{"uuid": "50c1e731-1daa-4408-8d3f-166aab12e11d"}]}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:49:55.357937 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-722d8f7a-c91c-4828-9b74-25328cb7640d tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.623287 Jun 15 15:49:55.358904 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1155 bytes} [Wed Jun 15 15:49:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4626 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 15:49:55.364138 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a04652a5-2e45-4350-aab1-9c7c5ea6ed7c tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] Calling method '.version_select at 0x7fd8d98175e0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:49:55.860364 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a04652a5-2e45-4350-aab1-9c7c5ea6ed7c tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0d2e3b3f-9e5a-46a0-a37d-71e59b042b5b" status: 200 len: 351 microversion: 2.1 time: 0.500166 Jun 15 15:49:55.861038 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 2/2] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 15:49:55 2022] GET /compute/v2.1/os-volumes/0d2e3b3f-9e5a-46a0-a37d-71e59b042b5b => generated 351 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:49:55.865533 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e1a11364-02d6-4b5e-9c61-485514306ab5 tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] Calling method '.version_select at 0x7fd8d9817940>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:49:55.875386 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.network.neutron [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] validate_networks() for [('50c1e731-1daa-4408-8d3f-166aab12e11d', None, None, None, None, None)] {{(pid=123934) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:49:56.117982 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e1a11364-02d6-4b5e-9c61-485514306ab5 tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a3eb780a-043c-4305-a753-ed797b7159bd" status: 200 len: 354 microversion: 2.1 time: 0.255902 Jun 15 15:49:56.119596 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 3/3] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 15:49:55 2022] GET /compute/v2.1/os-volumes/a3eb780a-043c-4305-a753-ed797b7159bd => generated 354 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:49:56.137974 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e70c745d-c3c1-4bd4-940b-0584d20a2e2d tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] Calling method '.version_select at 0x7fd8d9817dc0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:49:56.388152 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e70c745d-c3c1-4bd4-940b-0584d20a2e2d tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a3eb780a-043c-4305-a753-ed797b7159bd" status: 200 len: 354 microversion: 2.1 time: 0.261288 Jun 15 15:49:56.389800 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 4/4] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 15:49:56 2022] GET /compute/v2.1/os-volumes/a3eb780a-043c-4305-a753-ed797b7159bd => generated 354 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:49:56.405262 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-412d0ecb-81e0-447e-a984-4fdd0a53265f tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] Calling method '.version_select at 0x7fd8d982f4c0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:49:56.612401 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-412d0ecb-81e0-447e-a984-4fdd0a53265f tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/a3eb780a-043c-4305-a753-ed797b7159bd" status: 202 len: 0 microversion: 2.1 time: 0.210376 Jun 15 15:49:56.613037 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 5/5] 10.222.0.62 () {58 vars in 1247 bytes} [Wed Jun 15 15:49:56 2022] DELETE /compute/v2.1/os-volumes/a3eb780a-043c-4305-a753-ed797b7159bd => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:49:56.621498 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c5c90c8a-da78-456a-89db-2416b37cc872 tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] Calling method '.version_select at 0x7fd8d9817d30>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:49:56.787527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c5c90c8a-da78-456a-89db-2416b37cc872 tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a3eb780a-043c-4305-a753-ed797b7159bd" status: 200 len: 353 microversion: 2.1 time: 0.170117 Jun 15 15:49:56.788689 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 6/6] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 15:49:56 2022] GET /compute/v2.1/os-volumes/a3eb780a-043c-4305-a753-ed797b7159bd => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:49:57.492280 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Flavor limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:49:57.493440 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Image limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:49:57.494093 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Flavor pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:49:57.494649 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Image pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:49:57.495231 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:49:57.527111 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:49:57.527482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:49:57.528571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:49:57.529100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:49:57.584926 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Getting quotas for project a8fb15aaa4ac4d55a68b821f99bbffd7. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:49:57.595437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Getting quotas for user c1d2305db6284067bfb37c3b1bf198fa and project a8fb15aaa4ac4d55a68b821f99bbffd7. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:49:57.635308 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Going to run 1 instances... {{(pid=123934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:49:57.648403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:49:57.812119 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f94b0bdf-7556-4ae8-aa31-d3a91f1901b1 tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] Calling method '.version_select at 0x7fd8d9817c10>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:49:57.861391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e667830d-141c-4504-aa80-57e0afc8c964 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.325414 Jun 15 15:49:57.862638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 1/7] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:49:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:49:57.873379 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e4c6e47f-e696-4985-85a8-be393176df8d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:49:57.874021 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e4c6e47f-e696-4985-85a8-be393176df8d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:49:58.076219 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e4c6e47f-e696-4985-85a8-be393176df8d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:49:58.116722 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e4c6e47f-e696-4985-85a8-be393176df8d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1214 microversion: 2.1 time: 0.246695 Jun 15 15:49:58.118300 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 2/8] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:49:57 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:49:58.137050 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5656b646-3787-4d28-aa89-d54a505d47e0 tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] Calling method '.version_select at 0x7fd8d8f6bc10>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:49:58.175372 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-f94b0bdf-7556-4ae8-aa31-d3a91f1901b1 tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] HTTP exception thrown: Volume a3eb780a-043c-4305-a753-ed797b7159bd could not be found. Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f94b0bdf-7556-4ae8-aa31-d3a91f1901b1 tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] Request method failure captured: Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/os-volumes/a3eb780a-043c-4305-a753-ed797b7159bd HTTP/1.1 Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-e5Cfnm0gvHt2rJqPv2FP5s6-JRfUhcA1YuuO379lpoCcT49Iaer7RXD7lyqnOReI6ItixDVAdVlVE604YCyU84EBgTot92R4v97AiHspVg1a8SKTfvxNOZbwEY-wDHb03Y2DwP1GDyauZEAljrsd1xosMyE552P29jFJyTQWlVl0 Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: e35635738b4746d1980b91d367546d55 Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-VolumesGetTestJSON-811894627 Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:49:58.181849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e35635738b4746d1980b91d367546d55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35635738b4746d1980b91d367546d55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e35635738b4746d1980b91d367546d55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e35635738b4746d1980b91d367546d55", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-VolumesGetTestJSON-811894627 Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: e35635738b4746d1980b91d367546d55 Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-VolumesGetTestJSON-811894627 Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-VolumesGetTestJSON-811894627-project Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 73d38336bb17437ea02066d617d6b015 Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-VolumesGetTestJSON-811894627-project Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Volume a3eb780a-043c-4305-a753-ed797b7159bd could not be found. Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'a3eb780a-043c-4305-a753-ed797b7159bd'} Jun 15 15:49:58.183336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3eb780a-043c-4305-a753-ed797b7159bd could not be found. (HTTP 404) (Request-ID: req-0866c047-04ed-4320-800a-991e352a2e66) Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:49:58.184006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:49:58.184912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3eb780a-043c-4305-a753-ed797b7159bd could not be found. Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 15:49:58.185808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3eb780a-043c-4305-a753-ed797b7159bd could not be found. Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3eb780a-043c-4305-a753-ed797b7159bd could not be found. Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f94b0bdf-7556-4ae8-aa31-d3a91f1901b1 tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] Returning 404 to user: Volume a3eb780a-043c-4305-a753-ed797b7159bd could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f94b0bdf-7556-4ae8-aa31-d3a91f1901b1 tempest-VolumesGetTestJSON-811894627 tempest-VolumesGetTestJSON-811894627-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/a3eb780a-043c-4305-a753-ed797b7159bd" status: 404 len: 109 microversion: 2.1 time: 0.386477 Jun 15 15:49:58.186714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 7/9] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 15:49:57 2022] GET /compute/v2.1/os-volumes/a3eb780a-043c-4305-a753-ed797b7159bd => generated 109 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:49:58.423335 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5656b646-3787-4d28-aa89-d54a505d47e0 tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/88ae3308-3b32-473d-8d4f-54f2e9c328ac" status: 200 len: 350 microversion: 2.1 time: 0.303508 Jun 15 15:49:58.424167 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 3/10] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 15:49:58 2022] GET /compute/v2.1/os-volumes/88ae3308-3b32-473d-8d4f-54f2e9c328ac => generated 350 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:49:58.513733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e4ef7f43-cb59-4c70-a496-0bf6d48560b9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Action: 'create', calling method: .version_select at 0x7fd8d982fee0>, body: {"keypair": {"name": "tempest-keypair-1230254056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/s+a1QrmUVn4faRFRkCct1hFAw7z2JZUtcZIUHl4wuWn95l+oodSgptZAdh54pcxNKd/UUUGy7w7Vd7DuED0yW9nT9vFSNNOKZ9aZwcclCzzoY3F0ZiCr73qQoRVdbkw=="}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:49:58.625394 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-e4ef7f43-cb59-4c70-a496-0bf6d48560b9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Getting quotas for project 669dc76c39b3427b8c55fd47de62595f. Resources: {'key_pairs'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:49:58.644992 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-e4ef7f43-cb59-4c70-a496-0bf6d48560b9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Getting quotas for user 434c81b82dee404f8d143f1bdf56d3ca and project 669dc76c39b3427b8c55fd47de62595f. Resources: {'key_pairs'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:49:58.818376 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e4ef7f43-cb59-4c70-a496-0bf6d48560b9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.433299 Jun 15 15:49:58.820041 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 8/11] 10.222.0.62 () {60 vars in 1158 bytes} [Wed Jun 15 15:49:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:49:59.137738 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-51dda4cd-33b1-4b5b-8ffe-b5afd2219eec tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:49:59.138398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-51dda4cd-33b1-4b5b-8ffe-b5afd2219eec tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:49:59.311973 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-51dda4cd-33b1-4b5b-8ffe-b5afd2219eec tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:49:59.323886 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-51dda4cd-33b1-4b5b-8ffe-b5afd2219eec tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1214 microversion: 2.1 time: 0.190021 Jun 15 15:49:59.327278 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 4/12] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:49:59 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:00.225136 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-15ef8781-5677-46ae-a923-1788669aa26b tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] Calling method '.version_select at 0x7fd8d977aee0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:00.352100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-95beaab1-7dd9-40a8-b0be-97277a348c77 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:00.353887 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-95beaab1-7dd9-40a8-b0be-97277a348c77 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:00.386802 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95beaab1-7dd9-40a8-b0be-97277a348c77 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:00.388010 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95beaab1-7dd9-40a8-b0be-97277a348c77 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:00.392042 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95beaab1-7dd9-40a8-b0be-97277a348c77 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:00.396621 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95beaab1-7dd9-40a8-b0be-97277a348c77 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:00.424233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-15ef8781-5677-46ae-a923-1788669aa26b tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/ae45f71f-812f-4c09-8302-a6f930aed755" status: 200 len: 351 microversion: 2.1 time: 0.205220 Jun 15 15:50:00.424793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 9/13] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 15:50:00 2022] GET /compute/v2.1/os-volumes/ae45f71f-812f-4c09-8302-a6f930aed755 => generated 351 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:00.440207 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-85bdb2e2-da1a-4eea-9eb1-217b6fe1f69d tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] Calling method '.version_select at 0x7fd8d982f040>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:00.661830 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-85bdb2e2-da1a-4eea-9eb1-217b6fe1f69d tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.226142 Jun 15 15:50:00.662572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 10/14] 10.222.0.62 () {58 vars in 1133 bytes} [Wed Jun 15 15:50:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:00.676126 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-bfe305f0-65da-4a5e-ba49-9f2754b0540b tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] Calling method '.version_select at 0x7fd8d9725550>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:00.947693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-95beaab1-7dd9-40a8-b0be-97277a348c77 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:00.963453 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-95beaab1-7dd9-40a8-b0be-97277a348c77 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1210 microversion: 2.1 time: 0.621918 Jun 15 15:50:00.969131 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-bfe305f0-65da-4a5e-ba49-9f2754b0540b tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.297035 Jun 15 15:50:00.970184 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 11/15] 10.222.0.62 () {58 vars in 1148 bytes} [Wed Jun 15 15:50:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:00.987724 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e6418faf-49c0-44fd-acd6-841fe7eff4f3 tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] Calling method '.version_select at 0x7fd8d972a1f0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:00.994528 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 5/16] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:00 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1210 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:01.121982 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e6418faf-49c0-44fd-acd6-841fe7eff4f3 tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.142673 Jun 15 15:50:01.122532 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 12/17] 10.222.0.62 () {58 vars in 1133 bytes} [Wed Jun 15 15:50:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:01.133885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b50cf03c-062a-455e-97c3-a1286ca42c08 tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] Calling method '.version_select at 0x7fd8d8652d30>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:01.257250 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b50cf03c-062a-455e-97c3-a1286ca42c08 tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.127264 Jun 15 15:50:01.257846 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 6/18] 10.222.0.62 () {58 vars in 1166 bytes} [Wed Jun 15 15:50:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:01.270630 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a617e59e-3d94-4ab6-ba59-5cd2fab3f5ee tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] Calling method '.version_select at 0x7fd8da1fcb80>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:01.448717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a617e59e-3d94-4ab6-ba59-5cd2fab3f5ee tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.182453 Jun 15 15:50:01.450474 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 13/19] 10.222.0.62 () {58 vars in 1169 bytes} [Wed Jun 15 15:50:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:01.464602 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7c3489fc-84c9-4603-b531-906c1fee9a37 tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] Calling method '.version_select at 0x7fd8d86619d0>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:01.651923 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7c3489fc-84c9-4603-b531-906c1fee9a37 tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.191568 Jun 15 15:50:01.652739 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 7/20] 10.222.0.62 () {58 vars in 1154 bytes} [Wed Jun 15 15:50:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:01.667911 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-19a4caba-1b28-4642-80e6-0101ecea1069 tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] Calling method '.version_select at 0x7fd8d972a700>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:01.898508 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-19a4caba-1b28-4642-80e6-0101ecea1069 tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.236974 Jun 15 15:50:01.902780 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 14/21] 10.222.0.62 () {58 vars in 1187 bytes} [Wed Jun 15 15:50:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:01.913012 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e2006c1e-d4a9-4cc0-9489-ca801d00ae6f tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] Calling method '.version_select at 0x7fd8d86e3ca0>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:02.026366 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-94e596ea-8d8a-418b-82b5-675fac77b238 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:02.027947 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-94e596ea-8d8a-418b-82b5-675fac77b238 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:02.056825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94e596ea-8d8a-418b-82b5-675fac77b238 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:02.057452 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94e596ea-8d8a-418b-82b5-675fac77b238 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:02.058663 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94e596ea-8d8a-418b-82b5-675fac77b238 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:02.059703 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94e596ea-8d8a-418b-82b5-675fac77b238 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:02.066103 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e2006c1e-d4a9-4cc0-9489-ca801d00ae6f tempest-VolumesTestJSON-2112666691 tempest-VolumesTestJSON-2112666691-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.157016 Jun 15 15:50:02.068928 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 8/22] 10.222.0.62 () {58 vars in 1154 bytes} [Wed Jun 15 15:50:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:02.495931 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-94e596ea-8d8a-418b-82b5-675fac77b238 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:02.542827 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-94e596ea-8d8a-418b-82b5-675fac77b238 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1210 microversion: 2.1 time: 0.533130 Jun 15 15:50:02.543425 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 15/23] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:02 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1210 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:03.559938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fb597f82-9164-482b-b706-547ebc644059 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:03.560621 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fb597f82-9164-482b-b706-547ebc644059 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:03.575686 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb597f82-9164-482b-b706-547ebc644059 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:03.576161 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb597f82-9164-482b-b706-547ebc644059 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:03.576938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb597f82-9164-482b-b706-547ebc644059 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:03.580046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb597f82-9164-482b-b706-547ebc644059 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:03.818645 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fb597f82-9164-482b-b706-547ebc644059 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:03.826651 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fb597f82-9164-482b-b706-547ebc644059 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1210 microversion: 2.1 time: 0.270752 Jun 15 15:50:03.827272 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 16/24] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:03 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1210 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:03.865790 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bcddec50-8de7-4c39-9c24-a9aadea5d2bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Action: 'create', calling method: .version_select at 0x7fd8d86613a0>, body: {"keypair": {"name": "tempest-keypair-2044509986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7NLJyMAp5fIRLhGQ0XehPijwWK2XyXdxZV3kDQdyQ6hPIvjxyRpd9evjR8vsT5t7hOHkeuTB1dh8gIsuM+RGkP/v4fCgRHm7WqcgoDo+5bxyyK/VKpFaYcZ/iH0L2Fsg=="}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:03.927179 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-bcddec50-8de7-4c39-9c24-a9aadea5d2bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Getting quotas for project 9e7b007aaf80436f8fa691a12a95f21e. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:50:03.931963 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-bcddec50-8de7-4c39-9c24-a9aadea5d2bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Getting quotas for user 3af6df3efbb74db4958654503e17d82e and project 9e7b007aaf80436f8fa691a12a95f21e. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:50:04.001197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bcddec50-8de7-4c39-9c24-a9aadea5d2bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.676635 Jun 15 15:50:04.007604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 9/25] 10.222.0.62 () {62 vars in 1199 bytes} [Wed Jun 15 15:50:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 685 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 15:50:04.337336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-937492415", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddf1b2b0-3215-4fd9-b0bf-7ad7c9d71640"}], "security_groups": [{"name": "tempest-securitygroup--430598586"}], "key_name": "tempest-keypair-1230254056", "user_data": "}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:04.678639 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] validate_networks() for [('ddf1b2b0-3215-4fd9-b0bf-7ad7c9d71640', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:50:04.854279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6f2d7fb5-df57-486b-a46f-68e300838c02 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:04.855390 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6f2d7fb5-df57-486b-a46f-68e300838c02 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:04.863086 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6f2d7fb5-df57-486b-a46f-68e300838c02 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:04.863849 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6f2d7fb5-df57-486b-a46f-68e300838c02 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:04.865643 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6f2d7fb5-df57-486b-a46f-68e300838c02 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:04.866310 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6f2d7fb5-df57-486b-a46f-68e300838c02 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:05.082421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6f2d7fb5-df57-486b-a46f-68e300838c02 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:05.093746 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6f2d7fb5-df57-486b-a46f-68e300838c02 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1210 microversion: 2.1 time: 0.243406 Jun 15 15:50:05.105901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 10/26] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:04 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1210 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:05.337065 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-80659929-6412-421b-9455-4ce968fde9da tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: .version_select at 0x7fd8d85c5670>, body: {"keypair": {"name": "tempest-keypair-329052346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTOiLW1guhA0JsZMzPWmR8PevwHE7cv0Eh0gzDaLR5k7cvwxoFd08CYt+CM+w8bEG61lj+QxO9VzJg6q/7PWELzKFuJlHDaNXs2JSNIyREAP3MFLc3n5ACcKpxYZvh1MA=="}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:05.363298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-80659929-6412-421b-9455-4ce968fde9da tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for project 0496c4ee9cdf486684000904876d0b6b. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:50:05.378367 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-80659929-6412-421b-9455-4ce968fde9da tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for user fb838f931b7748e2baf6c2315d3cbd75 and project 0496c4ee9cdf486684000904876d0b6b. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:50:05.439792 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-80659929-6412-421b-9455-4ce968fde9da tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.304730 Jun 15 15:50:05.441257 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 11/27] 10.222.0.62 () {60 vars in 1158 bytes} [Wed Jun 15 15:50:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:05.645651 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:50:05.646529 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:50:05.647271 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:50:05.647907 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:50:05.648655 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:50:05.667675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:05.668579 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:05.670492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:05.671206 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:05.763616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Getting quotas for project 669dc76c39b3427b8c55fd47de62595f. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:50:05.773760 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Getting quotas for user 434c81b82dee404f8d143f1bdf56d3ca and project 669dc76c39b3427b8c55fd47de62595f. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:50:05.801711 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:50:05.804752 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:50:05.993745 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-188e753c-4cee-4cc7-85fa-a4160d5d4f4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.660993 Jun 15 15:50:05.994410 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 17/28] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:50:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:50:06.005087 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b3cc6fea-c533-4bfd-8ce3-4c959b196153 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:06.005728 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b3cc6fea-c533-4bfd-8ce3-4c959b196153 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:06.116498 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d7c63336-a520-4353-ad2f-3b4385ae69cb tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:06.121160 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d7c63336-a520-4353-ad2f-3b4385ae69cb tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:06.138242 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d7c63336-a520-4353-ad2f-3b4385ae69cb tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:06.145763 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d7c63336-a520-4353-ad2f-3b4385ae69cb tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:06.157270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d7c63336-a520-4353-ad2f-3b4385ae69cb tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:06.159207 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d7c63336-a520-4353-ad2f-3b4385ae69cb tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:06.268703 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b3cc6fea-c533-4bfd-8ce3-4c959b196153 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:06.286285 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b3cc6fea-c533-4bfd-8ce3-4c959b196153 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1237 microversion: 2.1 time: 0.282252 Jun 15 15:50:06.291523 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 12/29] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:05 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1237 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:06.312059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d7c63336-a520-4353-ad2f-3b4385ae69cb tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:06.325444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d7c63336-a520-4353-ad2f-3b4385ae69cb tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1210 microversion: 2.1 time: 0.215884 Jun 15 15:50:06.330161 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 18/30] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:06 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:07.308318 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a29060d0-37de-41b9-801b-9f41f657ded7 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:07.308932 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a29060d0-37de-41b9-801b-9f41f657ded7 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:07.347543 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-24cf6c74-d3c7-41fd-b9ea-e3529f35ea6f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:07.348055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-24cf6c74-d3c7-41fd-b9ea-e3529f35ea6f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:07.373583 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-24cf6c74-d3c7-41fd-b9ea-e3529f35ea6f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:07.374154 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-24cf6c74-d3c7-41fd-b9ea-e3529f35ea6f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:07.375047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-24cf6c74-d3c7-41fd-b9ea-e3529f35ea6f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:07.379327 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-24cf6c74-d3c7-41fd-b9ea-e3529f35ea6f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:07.551923 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:07.855962 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-24cf6c74-d3c7-41fd-b9ea-e3529f35ea6f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:07.872410 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-24cf6c74-d3c7-41fd-b9ea-e3529f35ea6f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1266 microversion: 2.1 time: 0.527343 Jun 15 15:50:07.875141 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 19/31] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:07 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1266 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:07.900172 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1872959698", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a79121ae-82b6-4471-a1d9-5c9a99177a07"}], "security_groups": [{"name": "tempest-securitygroup--137449154"}], "key_name": "tempest-keypair-2044509986", "user_data": "}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:07.932888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a29060d0-37de-41b9-801b-9f41f657ded7 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:07.945929 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a29060d0-37de-41b9-801b-9f41f657ded7 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1237 microversion: 2.1 time: 0.639679 Jun 15 15:50:07.946536 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 13/32] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:07 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1237 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:08.359853 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] validate_networks() for [('a79121ae-82b6-4471-a1d9-5c9a99177a07', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:50:08.887321 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-aa485e9e-34eb-4714-abe1-aec7323d2ac7 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:08.887944 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-aa485e9e-34eb-4714-abe1-aec7323d2ac7 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:08.902932 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa485e9e-34eb-4714-abe1-aec7323d2ac7 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:08.903392 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa485e9e-34eb-4714-abe1-aec7323d2ac7 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:08.904183 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa485e9e-34eb-4714-abe1-aec7323d2ac7 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:08.907504 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa485e9e-34eb-4714-abe1-aec7323d2ac7 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:10.004909 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-aa485e9e-34eb-4714-abe1-aec7323d2ac7 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:10.017242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-aa485e9e-34eb-4714-abe1-aec7323d2ac7 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1272 microversion: 2.1 time: 1.131630 Jun 15 15:50:10.030409 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 14/33] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:08 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1272 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:10.057423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e644a5ae-e7f9-4f01-b6ec-6700407af5f1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:10.058666 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e644a5ae-e7f9-4f01-b6ec-6700407af5f1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:10.075219 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e644a5ae-e7f9-4f01-b6ec-6700407af5f1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:10.076734 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e644a5ae-e7f9-4f01-b6ec-6700407af5f1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:10.080732 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e644a5ae-e7f9-4f01-b6ec-6700407af5f1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:10.082289 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e644a5ae-e7f9-4f01-b6ec-6700407af5f1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:10.229774 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e644a5ae-e7f9-4f01-b6ec-6700407af5f1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:10.242274 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e644a5ae-e7f9-4f01-b6ec-6700407af5f1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1295 microversion: 2.1 time: 0.193866 Jun 15 15:50:10.243470 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 15/34] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:10 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1295 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:10.462570 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:50:10.463154 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:50:10.464046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:50:10.464603 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:50:10.465103 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:50:10.483813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:10.488942 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:10.491308 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:10.493286 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:10.585324 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Getting quotas for project 9e7b007aaf80436f8fa691a12a95f21e. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:50:10.610126 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Getting quotas for user 3af6df3efbb74db4958654503e17d82e and project 9e7b007aaf80436f8fa691a12a95f21e. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:50:10.651397 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:50:10.659768 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:50:10.778475 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-cee44ef1-1361-4667-a01a-374bf1c03d78 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.901760 Jun 15 15:50:10.779164 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 20/35] 10.222.0.62 () {62 vars in 1187 bytes} [Wed Jun 15 15:50:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2903 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 15:50:10.791209 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bc68bba8-293f-4589-8240-e562bae9233d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:10.791812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bc68bba8-293f-4589-8240-e562bae9233d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:10.988892 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc68bba8-293f-4589-8240-e562bae9233d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:11.009009 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc68bba8-293f-4589-8240-e562bae9233d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:11.032366 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc68bba8-293f-4589-8240-e562bae9233d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:11.034072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bc68bba8-293f-4589-8240-e562bae9233d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1282 microversion: 2.20 time: 0.247081 Jun 15 15:50:11.034664 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 16/36] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:10 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1282 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:11.036521 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5fadf2a5-0f09-48b6-b6ca-37578406bc8f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:11.037324 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5fadf2a5-0f09-48b6-b6ca-37578406bc8f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:11.051103 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5fadf2a5-0f09-48b6-b6ca-37578406bc8f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:11.051964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5fadf2a5-0f09-48b6-b6ca-37578406bc8f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:11.052953 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5fadf2a5-0f09-48b6-b6ca-37578406bc8f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:11.054392 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5fadf2a5-0f09-48b6-b6ca-37578406bc8f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:11.270520 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0825ed82-8d24-4694-a38a-9624fd189933 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:11.274480 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0825ed82-8d24-4694-a38a-9624fd189933 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:11.313451 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0825ed82-8d24-4694-a38a-9624fd189933 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:11.314388 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0825ed82-8d24-4694-a38a-9624fd189933 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:11.316449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0825ed82-8d24-4694-a38a-9624fd189933 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:11.320593 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0825ed82-8d24-4694-a38a-9624fd189933 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:11.809515 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0825ed82-8d24-4694-a38a-9624fd189933 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:11.820245 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0825ed82-8d24-4694-a38a-9624fd189933 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1295 microversion: 2.1 time: 0.563004 Jun 15 15:50:11.820836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 17/37] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:11 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1295 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:12.064699 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2bf297b2-b09b-4cb2-83d9-f2f31de20be8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:12.066138 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2bf297b2-b09b-4cb2-83d9-f2f31de20be8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:12.076596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2bf297b2-b09b-4cb2-83d9-f2f31de20be8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:12.082376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2bf297b2-b09b-4cb2-83d9-f2f31de20be8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:12.084276 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2bf297b2-b09b-4cb2-83d9-f2f31de20be8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:12.087018 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2bf297b2-b09b-4cb2-83d9-f2f31de20be8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:12.129293 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5fadf2a5-0f09-48b6-b6ca-37578406bc8f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:12.161227 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5fadf2a5-0f09-48b6-b6ca-37578406bc8f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 1.128893 Jun 15 15:50:12.175808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 21/38] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:11 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:12.257655 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2053499473", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "597f7e5d-558d-4aed-88e5-ecbc7c009bb7"}], "security_groups": [{"name": "tempest-securitygroup--377255825"}], "key_name": "tempest-keypair-329052346", "user_data": "}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:12.303251 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2bf297b2-b09b-4cb2-83d9-f2f31de20be8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:12.324843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2bf297b2-b09b-4cb2-83d9-f2f31de20be8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:12.340290 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2bf297b2-b09b-4cb2-83d9-f2f31de20be8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:12.341757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2bf297b2-b09b-4cb2-83d9-f2f31de20be8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1286 microversion: 2.20 time: 0.292066 Jun 15 15:50:12.342548 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 18/39] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:12 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1286 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:50:12.592942 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] validate_networks() for [('597f7e5d-558d-4aed-88e5-ecbc7c009bb7', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:50:12.837968 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d6a8d3c8-86a4-4662-ba93-def120b3152a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:12.838841 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d6a8d3c8-86a4-4662-ba93-def120b3152a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:12.861853 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d6a8d3c8-86a4-4662-ba93-def120b3152a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:12.868123 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d6a8d3c8-86a4-4662-ba93-def120b3152a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:12.872525 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d6a8d3c8-86a4-4662-ba93-def120b3152a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:12.874371 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d6a8d3c8-86a4-4662-ba93-def120b3152a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:13.359917 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d6a8d3c8-86a4-4662-ba93-def120b3152a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:13.373982 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d6a8d3c8-86a4-4662-ba93-def120b3152a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.540207 Jun 15 15:50:13.374693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 19/40] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:12 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:13.384110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-17f6ec0c-c905-40f0-8938-e154ff4b5c2f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:13.384110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-17f6ec0c-c905-40f0-8938-e154ff4b5c2f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:13.426880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17f6ec0c-c905-40f0-8938-e154ff4b5c2f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:13.435094 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17f6ec0c-c905-40f0-8938-e154ff4b5c2f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:13.440981 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17f6ec0c-c905-40f0-8938-e154ff4b5c2f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:13.441719 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17f6ec0c-c905-40f0-8938-e154ff4b5c2f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:13.881732 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-17f6ec0c-c905-40f0-8938-e154ff4b5c2f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:13.903619 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-17f6ec0c-c905-40f0-8938-e154ff4b5c2f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.524741 Jun 15 15:50:13.907748 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 20/41] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:13 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:13.926986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6359cd59-11ee-4267-807e-5044f63bdc9e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:13.926986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6359cd59-11ee-4267-807e-5044f63bdc9e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:13.927167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:50:13.927167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:50:13.927167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:50:13.927167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:50:13.927167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:50:13.945052 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:13.945518 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:13.947526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:13.948100 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:13.960584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6359cd59-11ee-4267-807e-5044f63bdc9e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:13.961822 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6359cd59-11ee-4267-807e-5044f63bdc9e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:13.963604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6359cd59-11ee-4267-807e-5044f63bdc9e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:13.965106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6359cd59-11ee-4267-807e-5044f63bdc9e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:14.025484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for project 0496c4ee9cdf486684000904876d0b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:50:14.046030 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for user fb838f931b7748e2baf6c2315d3cbd75 and project 0496c4ee9cdf486684000904876d0b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:50:14.092722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:50:14.100845 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:50:14.171506 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6359cd59-11ee-4267-807e-5044f63bdc9e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:14.197052 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6359cd59-11ee-4267-807e-5044f63bdc9e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:14.200917 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6359cd59-11ee-4267-807e-5044f63bdc9e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:14.212209 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6359cd59-11ee-4267-807e-5044f63bdc9e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1334 microversion: 2.20 time: 0.294587 Jun 15 15:50:14.217161 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 21/42] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:13 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1334 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:14.285376 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d3ea1a50-786a-4a04-9e8f-556b6f90b7bd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.035976 Jun 15 15:50:14.287679 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 22/43] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:50:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:50:14.309978 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-38a1bf10-145c-4f0e-82b2-226546cd10e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:14.311560 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-38a1bf10-145c-4f0e-82b2-226546cd10e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:14.396343 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d8b14eec-8bdc-46d8-a2d8-d6f092526252 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:14.398141 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d8b14eec-8bdc-46d8-a2d8-d6f092526252 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:14.406416 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8b14eec-8bdc-46d8-a2d8-d6f092526252 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:14.407228 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8b14eec-8bdc-46d8-a2d8-d6f092526252 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:14.408378 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8b14eec-8bdc-46d8-a2d8-d6f092526252 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:14.408994 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8b14eec-8bdc-46d8-a2d8-d6f092526252 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:14.709253 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-38a1bf10-145c-4f0e-82b2-226546cd10e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:14.719577 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-38a1bf10-145c-4f0e-82b2-226546cd10e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1241 microversion: 2.1 time: 0.425956 Jun 15 15:50:14.725175 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 22/44] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:14 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1241 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:14.925125 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ae91f280-120f-4846-b19a-7509d310c71c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:14.926427 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ae91f280-120f-4846-b19a-7509d310c71c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:14.934140 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ae91f280-120f-4846-b19a-7509d310c71c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:14.956976 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ae91f280-120f-4846-b19a-7509d310c71c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:14.966624 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ae91f280-120f-4846-b19a-7509d310c71c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:14.967435 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ae91f280-120f-4846-b19a-7509d310c71c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:15.589534 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d8b14eec-8bdc-46d8-a2d8-d6f092526252 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:15.613112 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d8b14eec-8bdc-46d8-a2d8-d6f092526252 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 1.221541 Jun 15 15:50:15.615188 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 23/45] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:14 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:15.643420 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-774033b2-3610-4af4-b3b9-526b98c2e296 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:15.644614 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-774033b2-3610-4af4-b3b9-526b98c2e296 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:15.664293 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-774033b2-3610-4af4-b3b9-526b98c2e296 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:15.664755 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-774033b2-3610-4af4-b3b9-526b98c2e296 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:15.665554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-774033b2-3610-4af4-b3b9-526b98c2e296 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:15.665991 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-774033b2-3610-4af4-b3b9-526b98c2e296 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:16.036398 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-774033b2-3610-4af4-b3b9-526b98c2e296 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:16.080999 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-774033b2-3610-4af4-b3b9-526b98c2e296 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:16.089400 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-774033b2-3610-4af4-b3b9-526b98c2e296 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:16.096709 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-774033b2-3610-4af4-b3b9-526b98c2e296 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1340 microversion: 2.20 time: 0.470376 Jun 15 15:50:16.100633 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:15 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1340 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:16.133055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2a7c2974-2396-40ae-938a-b3ed9d95583e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:16.133618 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2a7c2974-2396-40ae-938a-b3ed9d95583e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:16.183543 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a7c2974-2396-40ae-938a-b3ed9d95583e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:16.184009 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a7c2974-2396-40ae-938a-b3ed9d95583e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:16.188742 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a7c2974-2396-40ae-938a-b3ed9d95583e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:16.196616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a7c2974-2396-40ae-938a-b3ed9d95583e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:16.228635 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ae91f280-120f-4846-b19a-7509d310c71c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:16.272379 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ae91f280-120f-4846-b19a-7509d310c71c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 1.336432 Jun 15 15:50:16.275665 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 23/47] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:14 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:16.521624 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2a7c2974-2396-40ae-938a-b3ed9d95583e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:16.537370 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2a7c2974-2396-40ae-938a-b3ed9d95583e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1237 microversion: 2.1 time: 0.433268 Jun 15 15:50:16.541936 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 25/48] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:16 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1237 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:16.632463 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-bc2a7884-a2a0-4446-9ff3-b1bc47580b00 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:16.633945 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-bc2a7884-a2a0-4446-9ff3-b1bc47580b00 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:16.643761 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bc2a7884-a2a0-4446-9ff3-b1bc47580b00 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:16.655023 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bc2a7884-a2a0-4446-9ff3-b1bc47580b00 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:16.656465 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bc2a7884-a2a0-4446-9ff3-b1bc47580b00 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:16.657030 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bc2a7884-a2a0-4446-9ff3-b1bc47580b00 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:16.855398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-61c9471c-776c-4b13-afbe-6d8d395c37d2 req-dbf7e517-2998-4b59-9f1a-45cd5075caf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876e0580-8662-495b-8d2b-99ca8643a1ca", "tag": "06cd31d6-3f6b-426a-bec7-4508a878ff64"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:16.889490 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-61c9471c-776c-4b13-afbe-6d8d395c37d2 req-dbf7e517-2998-4b59-9f1a-45cd5075caf5 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:16.890206 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-61c9471c-776c-4b13-afbe-6d8d395c37d2 req-dbf7e517-2998-4b59-9f1a-45cd5075caf5 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:16.952987 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-61c9471c-776c-4b13-afbe-6d8d395c37d2 req-dbf7e517-2998-4b59-9f1a-45cd5075caf5 service nova] Creating event network-changed:06cd31d6-3f6b-426a-bec7-4508a878ff64 for instance 876e0580-8662-495b-8d2b-99ca8643a1ca on hv-cinder-84599 Jun 15 15:50:16.953816 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-61c9471c-776c-4b13-afbe-6d8d395c37d2 req-dbf7e517-2998-4b59-9f1a-45cd5075caf5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123934) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 15:50:16.956635 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fd89ef74-6a6f-400c-8cf8-49ebf0e694a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:16.959832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fd89ef74-6a6f-400c-8cf8-49ebf0e694a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:16.962290 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fd89ef74-6a6f-400c-8cf8-49ebf0e694a2 None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:16.965261 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fd89ef74-6a6f-400c-8cf8-49ebf0e694a2 None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:16.982015 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.compute.rpcapi [None req-fd89ef74-6a6f-400c-8cf8-49ebf0e694a2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 15:50:16.991833 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fd89ef74-6a6f-400c-8cf8-49ebf0e694a2 None None] Releasing lock "compute-rpcapi-router" {{(pid=123934) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 15:50:17.054086 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fd89ef74-6a6f-400c-8cf8-49ebf0e694a2 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.776100 Jun 15 15:50:17.055610 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 24/49] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:17.117069 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-33ffc900-f265-4bcc-b5b2-c7865b812254 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:17.118749 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-33ffc900-f265-4bcc-b5b2-c7865b812254 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:17.168769 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33ffc900-f265-4bcc-b5b2-c7865b812254 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:17.174592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33ffc900-f265-4bcc-b5b2-c7865b812254 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:17.175754 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33ffc900-f265-4bcc-b5b2-c7865b812254 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:17.176215 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33ffc900-f265-4bcc-b5b2-c7865b812254 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:18.147682 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-33ffc900-f265-4bcc-b5b2-c7865b812254 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:18.178893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-33ffc900-f265-4bcc-b5b2-c7865b812254 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:18.178893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-33ffc900-f265-4bcc-b5b2-c7865b812254 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:18.178893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-33ffc900-f265-4bcc-b5b2-c7865b812254 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1340 microversion: 2.20 time: 1.055755 Jun 15 15:50:18.180937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 25/50] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:17 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1340 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:50:18.201210 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-16907c0a-6171-43cb-82f2-21e19e1fc348 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:18.202096 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-16907c0a-6171-43cb-82f2-21e19e1fc348 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:18.224213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16907c0a-6171-43cb-82f2-21e19e1fc348 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:18.224673 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16907c0a-6171-43cb-82f2-21e19e1fc348 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:18.225520 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16907c0a-6171-43cb-82f2-21e19e1fc348 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:18.225991 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16907c0a-6171-43cb-82f2-21e19e1fc348 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:18.375743 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-bc2a7884-a2a0-4446-9ff3-b1bc47580b00 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:18.399062 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-bc2a7884-a2a0-4446-9ff3-b1bc47580b00 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 1.770654 Jun 15 15:50:18.407348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 26/51] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:16 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:18.421935 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fde849b3-3658-4373-b1e2-8a895c92b7c6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:18.427802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fde849b3-3658-4373-b1e2-8a895c92b7c6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:18.496267 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fde849b3-3658-4373-b1e2-8a895c92b7c6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:18.497643 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fde849b3-3658-4373-b1e2-8a895c92b7c6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:18.499347 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fde849b3-3658-4373-b1e2-8a895c92b7c6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:18.525756 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fde849b3-3658-4373-b1e2-8a895c92b7c6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:18.997628 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fde849b3-3658-4373-b1e2-8a895c92b7c6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:19.013852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fde849b3-3658-4373-b1e2-8a895c92b7c6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1299 microversion: 2.1 time: 0.605246 Jun 15 15:50:19.014556 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 27/52] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:18 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1299 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:19.182451 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-16907c0a-6171-43cb-82f2-21e19e1fc348 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:19.191843 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4d6ee5bc-67e1-4b6f-aebc-51cafe324623 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:19.192460 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4d6ee5bc-67e1-4b6f-aebc-51cafe324623 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:19.210115 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4d6ee5bc-67e1-4b6f-aebc-51cafe324623 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:19.211034 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4d6ee5bc-67e1-4b6f-aebc-51cafe324623 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:19.211503 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-16907c0a-6171-43cb-82f2-21e19e1fc348 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 1.020109 Jun 15 15:50:19.214111 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4d6ee5bc-67e1-4b6f-aebc-51cafe324623 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:19.214501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 26/53] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:18 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:19.215237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4d6ee5bc-67e1-4b6f-aebc-51cafe324623 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:19.275828 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-116afa35-ca44-44b2-aa14-e19df58739a8 req-caad64a2-b916-4862-8482-74ea08a03d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e67259e-9dd3-4875-9185-fa11291a54d9", "tag": "a85add08-672c-4dce-8f28-ed6c32fa8484"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:19.288326 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-116afa35-ca44-44b2-aa14-e19df58739a8 req-caad64a2-b916-4862-8482-74ea08a03d5d service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:19.288994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-116afa35-ca44-44b2-aa14-e19df58739a8 req-caad64a2-b916-4862-8482-74ea08a03d5d service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:19.301338 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-116afa35-ca44-44b2-aa14-e19df58739a8 req-caad64a2-b916-4862-8482-74ea08a03d5d service nova] Creating event network-changed:a85add08-672c-4dce-8f28-ed6c32fa8484 for instance 9e67259e-9dd3-4875-9185-fa11291a54d9 on hv-cinder-84599 Jun 15 15:50:19.307068 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-116afa35-ca44-44b2-aa14-e19df58739a8 req-caad64a2-b916-4862-8482-74ea08a03d5d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034758 Jun 15 15:50:19.308289 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 27/54] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:19.420983 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-83a3f568-f187-40f0-882c-d3529c04d5a4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:19.422133 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-83a3f568-f187-40f0-882c-d3529c04d5a4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:19.434976 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-83a3f568-f187-40f0-882c-d3529c04d5a4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:19.436413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-83a3f568-f187-40f0-882c-d3529c04d5a4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:19.438616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-83a3f568-f187-40f0-882c-d3529c04d5a4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:19.444304 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-83a3f568-f187-40f0-882c-d3529c04d5a4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:19.480227 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4d6ee5bc-67e1-4b6f-aebc-51cafe324623 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:19.497647 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4d6ee5bc-67e1-4b6f-aebc-51cafe324623 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:19.499224 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4d6ee5bc-67e1-4b6f-aebc-51cafe324623 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:19.504822 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4d6ee5bc-67e1-4b6f-aebc-51cafe324623 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1340 microversion: 2.20 time: 0.320627 Jun 15 15:50:19.505836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 28/55] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:19 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1340 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:20.044881 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3b9a86e1-0003-4640-8843-c02c1c5fc33e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:20.045503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3b9a86e1-0003-4640-8843-c02c1c5fc33e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:20.055912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b9a86e1-0003-4640-8843-c02c1c5fc33e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:20.058316 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b9a86e1-0003-4640-8843-c02c1c5fc33e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:20.059464 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b9a86e1-0003-4640-8843-c02c1c5fc33e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:20.065419 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b9a86e1-0003-4640-8843-c02c1c5fc33e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:20.272767 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3b9a86e1-0003-4640-8843-c02c1c5fc33e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:20.301039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3b9a86e1-0003-4640-8843-c02c1c5fc33e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1299 microversion: 2.1 time: 0.259855 Jun 15 15:50:20.305204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 29/56] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:20 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1299 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:20.314877 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1e0c19d2-66f5-4531-8a81-929d27fcc98e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:20.316177 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1e0c19d2-66f5-4531-8a81-929d27fcc98e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:20.332975 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1e0c19d2-66f5-4531-8a81-929d27fcc98e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:20.333464 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1e0c19d2-66f5-4531-8a81-929d27fcc98e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:20.336041 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1e0c19d2-66f5-4531-8a81-929d27fcc98e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:20.336841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1e0c19d2-66f5-4531-8a81-929d27fcc98e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:20.494509 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-83a3f568-f187-40f0-882c-d3529c04d5a4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:20.511986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-83a3f568-f187-40f0-882c-d3529c04d5a4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 1.095151 Jun 15 15:50:20.524866 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 28/57] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:19 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:20.542093 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dc2d0e2f-7af0-473e-8855-d3a107c18867 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:20.545529 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-dc2d0e2f-7af0-473e-8855-d3a107c18867 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:20.560826 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dc2d0e2f-7af0-473e-8855-d3a107c18867 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:20.561265 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dc2d0e2f-7af0-473e-8855-d3a107c18867 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:20.566196 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dc2d0e2f-7af0-473e-8855-d3a107c18867 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:20.568665 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dc2d0e2f-7af0-473e-8855-d3a107c18867 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:21.258107 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dc2d0e2f-7af0-473e-8855-d3a107c18867 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:21.267809 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dc2d0e2f-7af0-473e-8855-d3a107c18867 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:21.269344 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dc2d0e2f-7af0-473e-8855-d3a107c18867 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:21.274994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-dc2d0e2f-7af0-473e-8855-d3a107c18867 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.748868 Jun 15 15:50:21.283093 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 29/58] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:20 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:21.322870 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-61a1afc9-2e63-4686-9ebb-f604a1a3d7f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:21.323682 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-61a1afc9-2e63-4686-9ebb-f604a1a3d7f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:21.333050 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-61a1afc9-2e63-4686-9ebb-f604a1a3d7f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:21.339484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-61a1afc9-2e63-4686-9ebb-f604a1a3d7f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:21.340302 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-61a1afc9-2e63-4686-9ebb-f604a1a3d7f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:21.340753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-61a1afc9-2e63-4686-9ebb-f604a1a3d7f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:21.541910 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-61a1afc9-2e63-4686-9ebb-f604a1a3d7f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:21.562642 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-61a1afc9-2e63-4686-9ebb-f604a1a3d7f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1299 microversion: 2.1 time: 0.244275 Jun 15 15:50:21.563527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 30/59] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:21 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1299 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:21.570482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e5ae6057-92de-43af-86f8-3a0a7be39fc8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:21.594090 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e5ae6057-92de-43af-86f8-3a0a7be39fc8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:21.618856 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:21.628767 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e5ae6057-92de-43af-86f8-3a0a7be39fc8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:21.629629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e5ae6057-92de-43af-86f8-3a0a7be39fc8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:21.630679 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e5ae6057-92de-43af-86f8-3a0a7be39fc8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:21.631348 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e5ae6057-92de-43af-86f8-3a0a7be39fc8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:21.650295 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:21.686391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1e0c19d2-66f5-4531-8a81-929d27fcc98e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:21.698543 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1e0c19d2-66f5-4531-8a81-929d27fcc98e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 1.391664 Jun 15 15:50:21.700112 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 30/60] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:20 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:22.296276 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-81232949-c40e-44e6-9cfb-ec7e9a969600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:22.297842 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-81232949-c40e-44e6-9cfb-ec7e9a969600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:22.313231 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:22.319048 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-81232949-c40e-44e6-9cfb-ec7e9a969600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:22.319443 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-81232949-c40e-44e6-9cfb-ec7e9a969600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:22.322536 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-81232949-c40e-44e6-9cfb-ec7e9a969600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:22.324339 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-81232949-c40e-44e6-9cfb-ec7e9a969600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:22.370568 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e5ae6057-92de-43af-86f8-3a0a7be39fc8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:22.393624 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e5ae6057-92de-43af-86f8-3a0a7be39fc8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.816131 Jun 15 15:50:22.395931 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 31/61] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:21 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:22.581735 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-36993570-b6e8-4754-bb5d-ac9f40484a33 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:22.582377 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-36993570-b6e8-4754-bb5d-ac9f40484a33 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:22.611407 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-36993570-b6e8-4754-bb5d-ac9f40484a33 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:22.611957 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-36993570-b6e8-4754-bb5d-ac9f40484a33 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:22.612713 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-36993570-b6e8-4754-bb5d-ac9f40484a33 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:22.613148 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-36993570-b6e8-4754-bb5d-ac9f40484a33 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:23.093023 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-81232949-c40e-44e6-9cfb-ec7e9a969600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:23.106632 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-81232949-c40e-44e6-9cfb-ec7e9a969600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:23.114198 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-81232949-c40e-44e6-9cfb-ec7e9a969600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:23.116600 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-81232949-c40e-44e6-9cfb-ec7e9a969600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.827196 Jun 15 15:50:23.117163 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 31/62] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:22 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:23.145013 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-55aac772-ed64-43c6-bde3-a7f67298e59e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:23.145651 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-55aac772-ed64-43c6-bde3-a7f67298e59e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:23.185881 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55aac772-ed64-43c6-bde3-a7f67298e59e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:23.187895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55aac772-ed64-43c6-bde3-a7f67298e59e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:23.188769 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55aac772-ed64-43c6-bde3-a7f67298e59e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:23.191502 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55aac772-ed64-43c6-bde3-a7f67298e59e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:23.607049 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-36993570-b6e8-4754-bb5d-ac9f40484a33 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:23.625266 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-36993570-b6e8-4754-bb5d-ac9f40484a33 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 1.048330 Jun 15 15:50:23.627615 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 32/63] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:22 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:23.638037 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6e7114e0-b179-45bb-813b-d786d2690a8c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:23.639368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6e7114e0-b179-45bb-813b-d786d2690a8c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:23.650146 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6e7114e0-b179-45bb-813b-d786d2690a8c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:23.651489 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6e7114e0-b179-45bb-813b-d786d2690a8c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:23.652576 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6e7114e0-b179-45bb-813b-d786d2690a8c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:23.653323 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6e7114e0-b179-45bb-813b-d786d2690a8c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:23.940620 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-55aac772-ed64-43c6-bde3-a7f67298e59e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:23.948323 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-55aac772-ed64-43c6-bde3-a7f67298e59e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.824805 Jun 15 15:50:23.949135 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 32/64] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:23 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:24.060616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6e7114e0-b179-45bb-813b-d786d2690a8c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:24.071597 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6e7114e0-b179-45bb-813b-d786d2690a8c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.442338 Jun 15 15:50:24.091285 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 33/65] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:23 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:24.151542 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-55d3349a-a727-4fe6-8012-659c8a56078b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:24.153637 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-55d3349a-a727-4fe6-8012-659c8a56078b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:24.167832 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=6 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:24.171607 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=22 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:24.173369 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55d3349a-a727-4fe6-8012-659c8a56078b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:24.174298 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55d3349a-a727-4fe6-8012-659c8a56078b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:24.175514 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55d3349a-a727-4fe6-8012-659c8a56078b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:24.176196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55d3349a-a727-4fe6-8012-659c8a56078b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:24.266707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=100 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:24.585959 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-55d3349a-a727-4fe6-8012-659c8a56078b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:24.597305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-55d3349a-a727-4fe6-8012-659c8a56078b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:24.598996 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-55d3349a-a727-4fe6-8012-659c8a56078b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:24.600135 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-55d3349a-a727-4fe6-8012-659c8a56078b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.467260 Jun 15 15:50:24.601024 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 33/66] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:24 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:24.606051 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-1a55ba98-a1b6-4d47-8e45-b79a5f0a5aa2 req-f17df1ec-f132-4a7a-a9f9-28a18b859629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa56f23-7713-4cc8-936c-b4f47a8506aa", "tag": "ce9ef32f-0f8b-4f92-af0e-f440f9f4f5a8"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:24.619544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-1a55ba98-a1b6-4d47-8e45-b79a5f0a5aa2 req-f17df1ec-f132-4a7a-a9f9-28a18b859629 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:24.620251 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-1a55ba98-a1b6-4d47-8e45-b79a5f0a5aa2 req-f17df1ec-f132-4a7a-a9f9-28a18b859629 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:24.649716 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-1a55ba98-a1b6-4d47-8e45-b79a5f0a5aa2 req-f17df1ec-f132-4a7a-a9f9-28a18b859629 service nova] Creating event network-changed:ce9ef32f-0f8b-4f92-af0e-f440f9f4f5a8 for instance caa56f23-7713-4cc8-936c-b4f47a8506aa on hv-cinder-84599 Jun 15 15:50:24.650400 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-1a55ba98-a1b6-4d47-8e45-b79a5f0a5aa2 req-f17df1ec-f132-4a7a-a9f9-28a18b859629 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123935) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 15 15:50:24.652298 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eaaf573a-e164-4621-b049-0cf2ab336c80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:24.652926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eaaf573a-e164-4621-b049-0cf2ab336c80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:24.654206 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eaaf573a-e164-4621-b049-0cf2ab336c80 None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:24.654833 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eaaf573a-e164-4621-b049-0cf2ab336c80 None None] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:24.666539 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.compute.rpcapi [None req-eaaf573a-e164-4621-b049-0cf2ab336c80 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 15 15:50:24.667706 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eaaf573a-e164-4621-b049-0cf2ab336c80 None None] Releasing lock "compute-rpcapi-router" {{(pid=123935) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 15 15:50:24.690454 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-eaaf573a-e164-4621-b049-0cf2ab336c80 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086827 Jun 15 15:50:24.691477 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 34/67] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:24.697571 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2c2e9a72-97d8-4f5c-9ddb-8f07cd8c0489 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:24.698352 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2c2e9a72-97d8-4f5c-9ddb-8f07cd8c0489 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:24.710528 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2c2e9a72-97d8-4f5c-9ddb-8f07cd8c0489 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:24.711351 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2c2e9a72-97d8-4f5c-9ddb-8f07cd8c0489 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:24.712480 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2c2e9a72-97d8-4f5c-9ddb-8f07cd8c0489 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:24.713069 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2c2e9a72-97d8-4f5c-9ddb-8f07cd8c0489 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:24.718408 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=26 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:24.920767 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2c2e9a72-97d8-4f5c-9ddb-8f07cd8c0489 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:24.929891 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2c2e9a72-97d8-4f5c-9ddb-8f07cd8c0489 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.236259 Jun 15 15:50:24.930268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 35/68] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:24 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:24.965575 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ba5ee77f-4304-46c7-b86c-719fa7a1a77f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:24.966181 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ba5ee77f-4304-46c7-b86c-719fa7a1a77f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:24.972831 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ba5ee77f-4304-46c7-b86c-719fa7a1a77f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:24.973273 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ba5ee77f-4304-46c7-b86c-719fa7a1a77f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:24.974194 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ba5ee77f-4304-46c7-b86c-719fa7a1a77f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:24.974784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ba5ee77f-4304-46c7-b86c-719fa7a1a77f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:25.034043 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-96b8cddb-c4cf-4693-aafe-900e2ea2b3dd req-c2852bf2-b1a6-4f0e-b9a7-54d8b6686a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ff33fe-05bf-4bd5-9159-69805bae0aed", "tag": "229f5bd2-2de2-41f9-ac9f-ef6b3af254d6"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:25.060388 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-96b8cddb-c4cf-4693-aafe-900e2ea2b3dd req-c2852bf2-b1a6-4f0e-b9a7-54d8b6686a1b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:25.061043 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-96b8cddb-c4cf-4693-aafe-900e2ea2b3dd req-c2852bf2-b1a6-4f0e-b9a7-54d8b6686a1b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:25.085095 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-96b8cddb-c4cf-4693-aafe-900e2ea2b3dd req-c2852bf2-b1a6-4f0e-b9a7-54d8b6686a1b service nova] Creating event network-changed:229f5bd2-2de2-41f9-ac9f-ef6b3af254d6 for instance c8ff33fe-05bf-4bd5-9159-69805bae0aed on hv-cinder-84599 Jun 15 15:50:25.092406 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-96b8cddb-c4cf-4693-aafe-900e2ea2b3dd req-c2852bf2-b1a6-4f0e-b9a7-54d8b6686a1b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.573530 Jun 15 15:50:25.093926 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 34/69] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:25.102430 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f02cb31f-8b75-4297-8507-c0c51464ae6d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:25.103145 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f02cb31f-8b75-4297-8507-c0c51464ae6d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:25.115576 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f02cb31f-8b75-4297-8507-c0c51464ae6d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:25.116197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f02cb31f-8b75-4297-8507-c0c51464ae6d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:25.117163 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f02cb31f-8b75-4297-8507-c0c51464ae6d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:25.117779 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f02cb31f-8b75-4297-8507-c0c51464ae6d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:25.148557 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ba5ee77f-4304-46c7-b86c-719fa7a1a77f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:25.156839 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ba5ee77f-4304-46c7-b86c-719fa7a1a77f tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.195105 Jun 15 15:50:25.166613 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 36/70] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:24 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:25.373127 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f02cb31f-8b75-4297-8507-c0c51464ae6d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:25.382142 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f02cb31f-8b75-4297-8507-c0c51464ae6d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.286558 Jun 15 15:50:25.382839 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 35/71] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:25 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:25.617368 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-23271bbe-df22-4ff3-bbf6-6c80b7049d24 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:25.618080 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-23271bbe-df22-4ff3-bbf6-6c80b7049d24 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:25.624048 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23271bbe-df22-4ff3-bbf6-6c80b7049d24 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:25.624536 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23271bbe-df22-4ff3-bbf6-6c80b7049d24 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:25.625292 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23271bbe-df22-4ff3-bbf6-6c80b7049d24 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:25.625724 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23271bbe-df22-4ff3-bbf6-6c80b7049d24 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:25.872007 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-23271bbe-df22-4ff3-bbf6-6c80b7049d24 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:25.881799 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-23271bbe-df22-4ff3-bbf6-6c80b7049d24 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:25.883738 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-23271bbe-df22-4ff3-bbf6-6c80b7049d24 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:25.888172 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-23271bbe-df22-4ff3-bbf6-6c80b7049d24 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.271751 Jun 15 15:50:25.897151 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:25 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:25.948826 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bc0eda21-8bfa-42c7-a77d-e94809b20856 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:25.950963 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bc0eda21-8bfa-42c7-a77d-e94809b20856 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:25.958671 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc0eda21-8bfa-42c7-a77d-e94809b20856 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:25.959407 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc0eda21-8bfa-42c7-a77d-e94809b20856 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:25.960549 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc0eda21-8bfa-42c7-a77d-e94809b20856 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:25.961286 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc0eda21-8bfa-42c7-a77d-e94809b20856 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:26.174771 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c79fa363-c560-47d2-a72e-8ed7d4b3606c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:26.175360 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c79fa363-c560-47d2-a72e-8ed7d4b3606c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:26.181841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c79fa363-c560-47d2-a72e-8ed7d4b3606c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:26.182287 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c79fa363-c560-47d2-a72e-8ed7d4b3606c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:26.183086 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c79fa363-c560-47d2-a72e-8ed7d4b3606c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:26.183513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c79fa363-c560-47d2-a72e-8ed7d4b3606c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:26.197295 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc0eda21-8bfa-42c7-a77d-e94809b20856 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:26.206486 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bc0eda21-8bfa-42c7-a77d-e94809b20856 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.262968 Jun 15 15:50:26.219278 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 36/73] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:25 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:26.360133 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c79fa363-c560-47d2-a72e-8ed7d4b3606c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:26.367640 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c79fa363-c560-47d2-a72e-8ed7d4b3606c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.197913 Jun 15 15:50:26.368342 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 38/74] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:26 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:26.401298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7c207469-38c9-463f-9268-d3fbeb66f132 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:26.401915 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7c207469-38c9-463f-9268-d3fbeb66f132 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:26.409665 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c207469-38c9-463f-9268-d3fbeb66f132 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:26.410376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c207469-38c9-463f-9268-d3fbeb66f132 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:26.411444 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c207469-38c9-463f-9268-d3fbeb66f132 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:26.411881 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c207469-38c9-463f-9268-d3fbeb66f132 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:26.557831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7c207469-38c9-463f-9268-d3fbeb66f132 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:26.566929 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7c207469-38c9-463f-9268-d3fbeb66f132 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.171099 Jun 15 15:50:26.567706 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 37/75] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:26 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:26.915402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-405fc335-d6f3-4f35-9bbb-1ff8d04ce461 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:26.916229 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-405fc335-d6f3-4f35-9bbb-1ff8d04ce461 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:26.924151 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-405fc335-d6f3-4f35-9bbb-1ff8d04ce461 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:26.924875 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-405fc335-d6f3-4f35-9bbb-1ff8d04ce461 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:26.926080 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-405fc335-d6f3-4f35-9bbb-1ff8d04ce461 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:26.927392 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-405fc335-d6f3-4f35-9bbb-1ff8d04ce461 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:27.118421 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-405fc335-d6f3-4f35-9bbb-1ff8d04ce461 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:27.135759 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-405fc335-d6f3-4f35-9bbb-1ff8d04ce461 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:27.137352 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-405fc335-d6f3-4f35-9bbb-1ff8d04ce461 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:27.139798 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-405fc335-d6f3-4f35-9bbb-1ff8d04ce461 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.229056 Jun 15 15:50:27.141805 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:26 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:27.223875 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-69b62d80-6cec-4806-a740-93b8b378c523 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:27.224486 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-69b62d80-6cec-4806-a740-93b8b378c523 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:27.226650 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:27.233535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-69b62d80-6cec-4806-a740-93b8b378c523 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:27.234021 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-69b62d80-6cec-4806-a740-93b8b378c523 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:27.235263 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-69b62d80-6cec-4806-a740-93b8b378c523 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:27.235951 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-69b62d80-6cec-4806-a740-93b8b378c523 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:27.386951 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5ddb511a-4d5b-4917-8d9e-fb560e95fcd4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:27.388768 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5ddb511a-4d5b-4917-8d9e-fb560e95fcd4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:27.398038 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-69b62d80-6cec-4806-a740-93b8b378c523 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:27.405940 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ddb511a-4d5b-4917-8d9e-fb560e95fcd4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:27.406548 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ddb511a-4d5b-4917-8d9e-fb560e95fcd4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:27.407459 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ddb511a-4d5b-4917-8d9e-fb560e95fcd4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:27.408097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ddb511a-4d5b-4917-8d9e-fb560e95fcd4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:27.409973 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-69b62d80-6cec-4806-a740-93b8b378c523 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.190480 Jun 15 15:50:27.410562 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 38/77] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:27 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:27.562481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5ddb511a-4d5b-4917-8d9e-fb560e95fcd4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:27.572148 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5ddb511a-4d5b-4917-8d9e-fb560e95fcd4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.191446 Jun 15 15:50:27.572802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 40/78] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:27 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:27.586885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4baf0bd9-69a5-4a64-90c7-4c824a8e9f39 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:27.587495 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4baf0bd9-69a5-4a64-90c7-4c824a8e9f39 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:27.593968 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4baf0bd9-69a5-4a64-90c7-4c824a8e9f39 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:27.594418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4baf0bd9-69a5-4a64-90c7-4c824a8e9f39 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:27.595408 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4baf0bd9-69a5-4a64-90c7-4c824a8e9f39 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:27.595829 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4baf0bd9-69a5-4a64-90c7-4c824a8e9f39 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:27.807336 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4baf0bd9-69a5-4a64-90c7-4c824a8e9f39 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:27.818779 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4baf0bd9-69a5-4a64-90c7-4c824a8e9f39 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.235614 Jun 15 15:50:27.821737 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 39/79] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:27 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:28.160090 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0fefdb37-423e-45b6-8d1a-6f20e1052b79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:28.160884 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0fefdb37-423e-45b6-8d1a-6f20e1052b79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:28.167612 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fefdb37-423e-45b6-8d1a-6f20e1052b79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:28.168235 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fefdb37-423e-45b6-8d1a-6f20e1052b79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:28.169310 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fefdb37-423e-45b6-8d1a-6f20e1052b79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:28.170000 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fefdb37-423e-45b6-8d1a-6f20e1052b79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:28.326072 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0fefdb37-423e-45b6-8d1a-6f20e1052b79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:28.337400 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0fefdb37-423e-45b6-8d1a-6f20e1052b79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:28.338953 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0fefdb37-423e-45b6-8d1a-6f20e1052b79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:28.340090 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0fefdb37-423e-45b6-8d1a-6f20e1052b79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.184752 Jun 15 15:50:28.350798 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 41/80] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:28 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:28.428726 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4c6f79d3-34c5-4caa-a3fd-18f77a7b0110 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:28.429391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4c6f79d3-34c5-4caa-a3fd-18f77a7b0110 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:28.443969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4c6f79d3-34c5-4caa-a3fd-18f77a7b0110 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:28.444797 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4c6f79d3-34c5-4caa-a3fd-18f77a7b0110 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:28.445719 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4c6f79d3-34c5-4caa-a3fd-18f77a7b0110 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:28.446283 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4c6f79d3-34c5-4caa-a3fd-18f77a7b0110 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:28.593322 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1d55633a-db7e-40b3-8c6a-d4c45490166e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:28.593322 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1d55633a-db7e-40b3-8c6a-d4c45490166e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:28.603007 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d55633a-db7e-40b3-8c6a-d4c45490166e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:28.603599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d55633a-db7e-40b3-8c6a-d4c45490166e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:28.604400 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d55633a-db7e-40b3-8c6a-d4c45490166e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:28.604829 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d55633a-db7e-40b3-8c6a-d4c45490166e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:28.641959 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4c6f79d3-34c5-4caa-a3fd-18f77a7b0110 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:28.655168 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4c6f79d3-34c5-4caa-a3fd-18f77a7b0110 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.229211 Jun 15 15:50:28.657471 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 40/81] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:28 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:28.783268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1d55633a-db7e-40b3-8c6a-d4c45490166e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:28.792093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1d55633a-db7e-40b3-8c6a-d4c45490166e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.206613 Jun 15 15:50:28.793018 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 42/82] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:28 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:28.842317 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-807c8062-e257-43bf-b20d-bb99729d3eb6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:28.842317 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-807c8062-e257-43bf-b20d-bb99729d3eb6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:28.850984 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-807c8062-e257-43bf-b20d-bb99729d3eb6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:28.850984 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-807c8062-e257-43bf-b20d-bb99729d3eb6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:28.850984 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-807c8062-e257-43bf-b20d-bb99729d3eb6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:28.852172 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-807c8062-e257-43bf-b20d-bb99729d3eb6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:29.023525 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-807c8062-e257-43bf-b20d-bb99729d3eb6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:29.037151 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-807c8062-e257-43bf-b20d-bb99729d3eb6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.204132 Jun 15 15:50:29.038136 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 41/83] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:28 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:29.360436 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-19ea0a4c-5ac3-45c5-8cc6-3fc97b3bf85f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:29.361042 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-19ea0a4c-5ac3-45c5-8cc6-3fc97b3bf85f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:29.367067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-19ea0a4c-5ac3-45c5-8cc6-3fc97b3bf85f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:29.367515 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-19ea0a4c-5ac3-45c5-8cc6-3fc97b3bf85f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:29.368317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-19ea0a4c-5ac3-45c5-8cc6-3fc97b3bf85f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:29.368785 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-19ea0a4c-5ac3-45c5-8cc6-3fc97b3bf85f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:29.532889 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-19ea0a4c-5ac3-45c5-8cc6-3fc97b3bf85f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:29.541491 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-19ea0a4c-5ac3-45c5-8cc6-3fc97b3bf85f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:29.544396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-19ea0a4c-5ac3-45c5-8cc6-3fc97b3bf85f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:29.545520 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-19ea0a4c-5ac3-45c5-8cc6-3fc97b3bf85f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.189718 Jun 15 15:50:29.547266 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 43/84] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:29 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:29.673957 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-82f2294b-f72e-4484-9491-f6cb68d763c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:29.674557 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-82f2294b-f72e-4484-9491-f6cb68d763c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:29.680662 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-82f2294b-f72e-4484-9491-f6cb68d763c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:29.681100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-82f2294b-f72e-4484-9491-f6cb68d763c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:29.681997 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-82f2294b-f72e-4484-9491-f6cb68d763c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:29.682432 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-82f2294b-f72e-4484-9491-f6cb68d763c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:29.809189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4351874d-7bef-494c-9f21-f724593c68de tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:29.809884 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4351874d-7bef-494c-9f21-f724593c68de tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:29.814056 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-82f2294b-f72e-4484-9491-f6cb68d763c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:29.816852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4351874d-7bef-494c-9f21-f724593c68de tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:29.817306 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4351874d-7bef-494c-9f21-f724593c68de tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:29.818125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4351874d-7bef-494c-9f21-f724593c68de tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:29.818710 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4351874d-7bef-494c-9f21-f724593c68de tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:29.822476 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-82f2294b-f72e-4484-9491-f6cb68d763c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.152927 Jun 15 15:50:29.823078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 42/85] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:29 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:29.952068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4351874d-7bef-494c-9f21-f724593c68de tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:29.960001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4351874d-7bef-494c-9f21-f724593c68de tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.154791 Jun 15 15:50:29.960557 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 44/86] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:29 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:30.053479 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-16a75b7c-72d2-4e01-8e48-7c27159674c1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:30.054098 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-16a75b7c-72d2-4e01-8e48-7c27159674c1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:30.061516 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16a75b7c-72d2-4e01-8e48-7c27159674c1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:30.061516 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16a75b7c-72d2-4e01-8e48-7c27159674c1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:30.062019 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16a75b7c-72d2-4e01-8e48-7c27159674c1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:30.062621 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16a75b7c-72d2-4e01-8e48-7c27159674c1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:30.206577 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-16a75b7c-72d2-4e01-8e48-7c27159674c1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:30.215771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-16a75b7c-72d2-4e01-8e48-7c27159674c1 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.165994 Jun 15 15:50:30.225575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 43/87] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:30 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:30.563984 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6365536b-dce7-4d5a-86c2-193e0b496f80 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:30.564594 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6365536b-dce7-4d5a-86c2-193e0b496f80 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:30.574358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6365536b-dce7-4d5a-86c2-193e0b496f80 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:30.574358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6365536b-dce7-4d5a-86c2-193e0b496f80 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:30.574358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6365536b-dce7-4d5a-86c2-193e0b496f80 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:30.574358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6365536b-dce7-4d5a-86c2-193e0b496f80 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:30.709499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6365536b-dce7-4d5a-86c2-193e0b496f80 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:30.718177 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6365536b-dce7-4d5a-86c2-193e0b496f80 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:30.720420 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6365536b-dce7-4d5a-86c2-193e0b496f80 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:30.721656 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6365536b-dce7-4d5a-86c2-193e0b496f80 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.161658 Jun 15 15:50:30.722303 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 45/88] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:30 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:30.840169 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2624b7d8-e42a-4188-9ad7-3a6f63e3bae5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:30.840784 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2624b7d8-e42a-4188-9ad7-3a6f63e3bae5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:30.847316 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2624b7d8-e42a-4188-9ad7-3a6f63e3bae5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:30.847767 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2624b7d8-e42a-4188-9ad7-3a6f63e3bae5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:30.848525 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2624b7d8-e42a-4188-9ad7-3a6f63e3bae5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:30.848960 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2624b7d8-e42a-4188-9ad7-3a6f63e3bae5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:30.972490 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2624b7d8-e42a-4188-9ad7-3a6f63e3bae5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:30.976328 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0641df13-a124-445e-8f27-ee8763618e62 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:30.976934 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0641df13-a124-445e-8f27-ee8763618e62 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:30.980047 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2624b7d8-e42a-4188-9ad7-3a6f63e3bae5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.143625 Jun 15 15:50:30.980611 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 44/89] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:30 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:30.982973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0641df13-a124-445e-8f27-ee8763618e62 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:30.983427 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0641df13-a124-445e-8f27-ee8763618e62 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:30.985290 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0641df13-a124-445e-8f27-ee8763618e62 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:30.985726 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0641df13-a124-445e-8f27-ee8763618e62 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:31.113754 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0641df13-a124-445e-8f27-ee8763618e62 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:31.121106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0641df13-a124-445e-8f27-ee8763618e62 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.148629 Jun 15 15:50:31.121666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 46/90] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:30 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:31.232980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dbcf984b-fcee-48ad-9e83-df0a4e9d3b4f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:31.233612 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-dbcf984b-fcee-48ad-9e83-df0a4e9d3b4f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:31.239647 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbcf984b-fcee-48ad-9e83-df0a4e9d3b4f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:31.240090 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbcf984b-fcee-48ad-9e83-df0a4e9d3b4f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:31.240840 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbcf984b-fcee-48ad-9e83-df0a4e9d3b4f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:31.241271 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbcf984b-fcee-48ad-9e83-df0a4e9d3b4f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:31.522303 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dbcf984b-fcee-48ad-9e83-df0a4e9d3b4f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:31.529641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-dbcf984b-fcee-48ad-9e83-df0a4e9d3b4f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.300561 Jun 15 15:50:31.530195 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 45/91] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:31 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:31.739873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c18b45f5-ddaf-4150-a58d-28f5ea02680c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:31.740482 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c18b45f5-ddaf-4150-a58d-28f5ea02680c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:31.746466 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c18b45f5-ddaf-4150-a58d-28f5ea02680c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:31.746953 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c18b45f5-ddaf-4150-a58d-28f5ea02680c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:31.747716 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c18b45f5-ddaf-4150-a58d-28f5ea02680c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:31.748151 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c18b45f5-ddaf-4150-a58d-28f5ea02680c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:31.872476 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c18b45f5-ddaf-4150-a58d-28f5ea02680c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:31.881178 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c18b45f5-ddaf-4150-a58d-28f5ea02680c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:31.882760 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c18b45f5-ddaf-4150-a58d-28f5ea02680c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:31.883855 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c18b45f5-ddaf-4150-a58d-28f5ea02680c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.147928 Jun 15 15:50:31.884415 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 47/92] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:31 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:31.997325 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d4193aa9-58d5-435d-9296-137708cff969 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:31.997864 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d4193aa9-58d5-435d-9296-137708cff969 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:32.004312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4193aa9-58d5-435d-9296-137708cff969 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:32.004757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4193aa9-58d5-435d-9296-137708cff969 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:32.005508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4193aa9-58d5-435d-9296-137708cff969 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:32.005945 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4193aa9-58d5-435d-9296-137708cff969 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:32.133583 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d4193aa9-58d5-435d-9296-137708cff969 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:32.137352 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-406a9348-fbce-4324-9135-7f58ac49f6a6 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:32.137963 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-406a9348-fbce-4324-9135-7f58ac49f6a6 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:32.141619 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d4193aa9-58d5-435d-9296-137708cff969 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.148205 Jun 15 15:50:32.142176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 46/93] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:31 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:32.144505 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-406a9348-fbce-4324-9135-7f58ac49f6a6 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:32.144952 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-406a9348-fbce-4324-9135-7f58ac49f6a6 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:32.145714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-406a9348-fbce-4324-9135-7f58ac49f6a6 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:32.146149 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-406a9348-fbce-4324-9135-7f58ac49f6a6 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:32.282266 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-406a9348-fbce-4324-9135-7f58ac49f6a6 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:32.290028 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-406a9348-fbce-4324-9135-7f58ac49f6a6 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.156552 Jun 15 15:50:32.290587 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 48/94] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:32 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:32.546835 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bf719809-d137-4f9e-8af1-53b9a0c15db0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:32.547384 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bf719809-d137-4f9e-8af1-53b9a0c15db0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:32.553413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf719809-d137-4f9e-8af1-53b9a0c15db0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:32.553862 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf719809-d137-4f9e-8af1-53b9a0c15db0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:32.554617 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf719809-d137-4f9e-8af1-53b9a0c15db0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:32.555077 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf719809-d137-4f9e-8af1-53b9a0c15db0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:32.681597 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bf719809-d137-4f9e-8af1-53b9a0c15db0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:32.689602 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bf719809-d137-4f9e-8af1-53b9a0c15db0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.146735 Jun 15 15:50:32.690167 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 47/95] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:32 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:32.902043 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-13931755-5f34-4d25-b241-5d5c1fb1889e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:32.902708 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-13931755-5f34-4d25-b241-5d5c1fb1889e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:32.909707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-13931755-5f34-4d25-b241-5d5c1fb1889e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:32.910137 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-13931755-5f34-4d25-b241-5d5c1fb1889e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:32.910879 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-13931755-5f34-4d25-b241-5d5c1fb1889e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:32.911575 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-13931755-5f34-4d25-b241-5d5c1fb1889e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:33.039136 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-13931755-5f34-4d25-b241-5d5c1fb1889e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:33.046978 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-13931755-5f34-4d25-b241-5d5c1fb1889e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:33.048471 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-13931755-5f34-4d25-b241-5d5c1fb1889e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:33.049555 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-13931755-5f34-4d25-b241-5d5c1fb1889e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.151406 Jun 15 15:50:33.050103 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 49/96] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:32 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:33.158905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8897cd4b-dba0-4592-82cb-f36af1e79709 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:33.159523 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8897cd4b-dba0-4592-82cb-f36af1e79709 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:33.165866 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8897cd4b-dba0-4592-82cb-f36af1e79709 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:33.166315 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8897cd4b-dba0-4592-82cb-f36af1e79709 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:33.167102 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8897cd4b-dba0-4592-82cb-f36af1e79709 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:33.167537 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8897cd4b-dba0-4592-82cb-f36af1e79709 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:33.185115 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:33.295316 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8897cd4b-dba0-4592-82cb-f36af1e79709 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:33.302513 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8897cd4b-dba0-4592-82cb-f36af1e79709 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.148107 Jun 15 15:50:33.303109 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 48/97] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:33 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:33.307318 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5ada78c4-7f2a-4b0c-8b1d-fda3abb03b54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:33.307922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5ada78c4-7f2a-4b0c-8b1d-fda3abb03b54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:33.314029 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ada78c4-7f2a-4b0c-8b1d-fda3abb03b54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:33.314478 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ada78c4-7f2a-4b0c-8b1d-fda3abb03b54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:33.315270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ada78c4-7f2a-4b0c-8b1d-fda3abb03b54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:33.315707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ada78c4-7f2a-4b0c-8b1d-fda3abb03b54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:33.333806 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=100 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:33.453729 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5ada78c4-7f2a-4b0c-8b1d-fda3abb03b54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:33.461176 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5ada78c4-7f2a-4b0c-8b1d-fda3abb03b54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.157698 Jun 15 15:50:33.461732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 50/98] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:33 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:33.706577 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0f19da32-bb2d-4fdc-976e-9dbc59fc7d60 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:33.707217 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0f19da32-bb2d-4fdc-976e-9dbc59fc7d60 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:33.713300 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0f19da32-bb2d-4fdc-976e-9dbc59fc7d60 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:33.713749 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0f19da32-bb2d-4fdc-976e-9dbc59fc7d60 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:33.714509 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0f19da32-bb2d-4fdc-976e-9dbc59fc7d60 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:33.714976 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0f19da32-bb2d-4fdc-976e-9dbc59fc7d60 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:33.847489 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0f19da32-bb2d-4fdc-976e-9dbc59fc7d60 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:33.854862 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0f19da32-bb2d-4fdc-976e-9dbc59fc7d60 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.152796 Jun 15 15:50:33.855446 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 49/99] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:33 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:34.072803 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7cede75a-3849-4ffd-ba76-6edf8359ed79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:34.077078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7cede75a-3849-4ffd-ba76-6edf8359ed79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:34.089655 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7cede75a-3849-4ffd-ba76-6edf8359ed79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:34.090108 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7cede75a-3849-4ffd-ba76-6edf8359ed79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:34.097117 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7cede75a-3849-4ffd-ba76-6edf8359ed79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:34.097358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7cede75a-3849-4ffd-ba76-6edf8359ed79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:34.319938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bb30fc73-b4e2-4071-b628-eebe44e48085 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:34.320572 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bb30fc73-b4e2-4071-b628-eebe44e48085 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:34.325925 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7cede75a-3849-4ffd-ba76-6edf8359ed79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:34.326799 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bb30fc73-b4e2-4071-b628-eebe44e48085 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:34.327504 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bb30fc73-b4e2-4071-b628-eebe44e48085 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:34.328456 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bb30fc73-b4e2-4071-b628-eebe44e48085 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:34.329067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bb30fc73-b4e2-4071-b628-eebe44e48085 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:34.337337 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7cede75a-3849-4ffd-ba76-6edf8359ed79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:34.340122 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7cede75a-3849-4ffd-ba76-6edf8359ed79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:34.342025 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7cede75a-3849-4ffd-ba76-6edf8359ed79 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.277509 Jun 15 15:50:34.347526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 51/100] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:34 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:34.477479 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-bd7a7223-7797-4726-a964-184c0987f1b1 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:34.478451 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-bd7a7223-7797-4726-a964-184c0987f1b1 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:34.485895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bd7a7223-7797-4726-a964-184c0987f1b1 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:34.486630 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bd7a7223-7797-4726-a964-184c0987f1b1 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:34.487880 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bd7a7223-7797-4726-a964-184c0987f1b1 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:34.488522 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bd7a7223-7797-4726-a964-184c0987f1b1 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:34.525974 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bb30fc73-b4e2-4071-b628-eebe44e48085 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:34.538236 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bb30fc73-b4e2-4071-b628-eebe44e48085 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.222287 Jun 15 15:50:34.539408 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 50/101] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:34 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:34.669775 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-bd7a7223-7797-4726-a964-184c0987f1b1 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:34.672180 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:34.679003 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-bd7a7223-7797-4726-a964-184c0987f1b1 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.205493 Jun 15 15:50:34.679892 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 52/102] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:34 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:34.872330 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ff8fa6f3-8f04-45b2-aaa9-a07195a41936 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:34.873357 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ff8fa6f3-8f04-45b2-aaa9-a07195a41936 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:34.880492 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ff8fa6f3-8f04-45b2-aaa9-a07195a41936 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:34.880950 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ff8fa6f3-8f04-45b2-aaa9-a07195a41936 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:34.881716 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ff8fa6f3-8f04-45b2-aaa9-a07195a41936 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:34.882148 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ff8fa6f3-8f04-45b2-aaa9-a07195a41936 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:35.033025 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ff8fa6f3-8f04-45b2-aaa9-a07195a41936 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:35.044447 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ff8fa6f3-8f04-45b2-aaa9-a07195a41936 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.175573 Jun 15 15:50:35.045857 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 51/103] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:34 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:35.361647 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9179d050-b434-4d53-8ef9-ca7c64b6fc54 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:35.362372 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9179d050-b434-4d53-8ef9-ca7c64b6fc54 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:35.368966 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9179d050-b434-4d53-8ef9-ca7c64b6fc54 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:35.369393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9179d050-b434-4d53-8ef9-ca7c64b6fc54 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:35.370157 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9179d050-b434-4d53-8ef9-ca7c64b6fc54 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:35.370593 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9179d050-b434-4d53-8ef9-ca7c64b6fc54 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:35.553327 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9179d050-b434-4d53-8ef9-ca7c64b6fc54 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:35.558623 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-57c44653-eac7-44d7-a736-9e5c8d3f2b90 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:35.561272 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9179d050-b434-4d53-8ef9-ca7c64b6fc54 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:35.563003 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9179d050-b434-4d53-8ef9-ca7c64b6fc54 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:35.564316 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9179d050-b434-4d53-8ef9-ca7c64b6fc54 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.207198 Jun 15 15:50:35.574580 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-57c44653-eac7-44d7-a736-9e5c8d3f2b90 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:35.574580 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57c44653-eac7-44d7-a736-9e5c8d3f2b90 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:35.574580 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57c44653-eac7-44d7-a736-9e5c8d3f2b90 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:35.574580 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57c44653-eac7-44d7-a736-9e5c8d3f2b90 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:35.575312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57c44653-eac7-44d7-a736-9e5c8d3f2b90 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:35.576184 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 53/104] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:35 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:35.697135 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b0193c6e-cb8f-4631-bb10-0a9e0b9c0e54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:35.698140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b0193c6e-cb8f-4631-bb10-0a9e0b9c0e54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:35.706141 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b0193c6e-cb8f-4631-bb10-0a9e0b9c0e54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:35.706911 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b0193c6e-cb8f-4631-bb10-0a9e0b9c0e54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:35.708060 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b0193c6e-cb8f-4631-bb10-0a9e0b9c0e54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:35.708784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b0193c6e-cb8f-4631-bb10-0a9e0b9c0e54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:35.719796 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-57c44653-eac7-44d7-a736-9e5c8d3f2b90 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:35.727837 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-57c44653-eac7-44d7-a736-9e5c8d3f2b90 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.173083 Jun 15 15:50:35.729205 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 52/105] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:35 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:35.862980 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b0193c6e-cb8f-4631-bb10-0a9e0b9c0e54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:35.871448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b0193c6e-cb8f-4631-bb10-0a9e0b9c0e54 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.178987 Jun 15 15:50:35.872018 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 54/106] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:35 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:36.063392 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-74d8cbc3-2f9a-4439-b850-abd95d9aabd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:36.063999 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-74d8cbc3-2f9a-4439-b850-abd95d9aabd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:36.069904 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-74d8cbc3-2f9a-4439-b850-abd95d9aabd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:36.070351 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-74d8cbc3-2f9a-4439-b850-abd95d9aabd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:36.071144 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-74d8cbc3-2f9a-4439-b850-abd95d9aabd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:36.071575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-74d8cbc3-2f9a-4439-b850-abd95d9aabd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:36.207687 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-74d8cbc3-2f9a-4439-b850-abd95d9aabd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:36.220272 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-74d8cbc3-2f9a-4439-b850-abd95d9aabd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.159289 Jun 15 15:50:36.230991 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 53/107] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:36 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:36.581627 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-720619e1-1eb3-4712-bb5f-786057bac199 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:36.582230 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-720619e1-1eb3-4712-bb5f-786057bac199 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:36.588111 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-720619e1-1eb3-4712-bb5f-786057bac199 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:36.588529 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-720619e1-1eb3-4712-bb5f-786057bac199 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:36.589300 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-720619e1-1eb3-4712-bb5f-786057bac199 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:36.589714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-720619e1-1eb3-4712-bb5f-786057bac199 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:36.719251 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-720619e1-1eb3-4712-bb5f-786057bac199 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:36.727198 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-720619e1-1eb3-4712-bb5f-786057bac199 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:36.728738 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-720619e1-1eb3-4712-bb5f-786057bac199 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:36.729844 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-720619e1-1eb3-4712-bb5f-786057bac199 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.152452 Jun 15 15:50:36.730399 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 55/108] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:36 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:50:36.745137 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-63432c4f-34c2-41dd-ae71-e8d55f0fc8b2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:36.746281 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-63432c4f-34c2-41dd-ae71-e8d55f0fc8b2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:36.753127 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-63432c4f-34c2-41dd-ae71-e8d55f0fc8b2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:36.753579 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-63432c4f-34c2-41dd-ae71-e8d55f0fc8b2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:36.754342 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-63432c4f-34c2-41dd-ae71-e8d55f0fc8b2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:36.754801 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-63432c4f-34c2-41dd-ae71-e8d55f0fc8b2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:36.888610 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-63432c4f-34c2-41dd-ae71-e8d55f0fc8b2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:36.888750 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-cc37c1d5-b2ca-42b2-ac0f-588fd3b69aad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:36.889226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-cc37c1d5-b2ca-42b2-ac0f-588fd3b69aad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:36.895764 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cc37c1d5-b2ca-42b2-ac0f-588fd3b69aad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:36.896483 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cc37c1d5-b2ca-42b2-ac0f-588fd3b69aad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:36.897332 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-63432c4f-34c2-41dd-ae71-e8d55f0fc8b2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.155983 Jun 15 15:50:36.897476 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cc37c1d5-b2ca-42b2-ac0f-588fd3b69aad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:36.897912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cc37c1d5-b2ca-42b2-ac0f-588fd3b69aad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:36.898202 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 54/109] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:36 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:37.045478 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-cc37c1d5-b2ca-42b2-ac0f-588fd3b69aad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:37.053705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-cc37c1d5-b2ca-42b2-ac0f-588fd3b69aad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.169009 Jun 15 15:50:37.054272 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 56/110] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:36 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:37.240558 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-183c4db2-55ca-4f54-bf3c-5643ed0a2806 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:37.241588 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-183c4db2-55ca-4f54-bf3c-5643ed0a2806 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:37.251550 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-183c4db2-55ca-4f54-bf3c-5643ed0a2806 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:37.252002 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-183c4db2-55ca-4f54-bf3c-5643ed0a2806 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:37.252792 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-183c4db2-55ca-4f54-bf3c-5643ed0a2806 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:37.253231 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-183c4db2-55ca-4f54-bf3c-5643ed0a2806 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:37.393688 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-183c4db2-55ca-4f54-bf3c-5643ed0a2806 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:37.401101 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-183c4db2-55ca-4f54-bf3c-5643ed0a2806 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.165076 Jun 15 15:50:37.401664 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 55/111] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:37 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:37.747457 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-113e1fea-11c7-47e0-9d88-f738ab9b97ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:37.748071 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-113e1fea-11c7-47e0-9d88-f738ab9b97ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:37.754991 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-113e1fea-11c7-47e0-9d88-f738ab9b97ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:37.754991 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-113e1fea-11c7-47e0-9d88-f738ab9b97ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:37.755781 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-113e1fea-11c7-47e0-9d88-f738ab9b97ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:37.755884 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-113e1fea-11c7-47e0-9d88-f738ab9b97ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:37.913913 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1e4ad584-99d4-4459-bd00-fb9bdb246dd8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:37.914900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1e4ad584-99d4-4459-bd00-fb9bdb246dd8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:37.916018 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-113e1fea-11c7-47e0-9d88-f738ab9b97ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:37.921077 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1e4ad584-99d4-4459-bd00-fb9bdb246dd8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:37.921523 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1e4ad584-99d4-4459-bd00-fb9bdb246dd8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:37.922460 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1e4ad584-99d4-4459-bd00-fb9bdb246dd8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:37.922942 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1e4ad584-99d4-4459-bd00-fb9bdb246dd8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:37.935189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-113e1fea-11c7-47e0-9d88-f738ab9b97ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:37.943215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-113e1fea-11c7-47e0-9d88-f738ab9b97ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:37.943215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-113e1fea-11c7-47e0-9d88-f738ab9b97ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.196273 Jun 15 15:50:37.943215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 57/112] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:37 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:38.070850 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3f06398d-59ed-4844-a003-489ae77ab01c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:38.071784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3f06398d-59ed-4844-a003-489ae77ab01c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:38.078770 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f06398d-59ed-4844-a003-489ae77ab01c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:38.079318 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f06398d-59ed-4844-a003-489ae77ab01c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:38.079985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f06398d-59ed-4844-a003-489ae77ab01c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:38.080606 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f06398d-59ed-4844-a003-489ae77ab01c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:38.126798 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1e4ad584-99d4-4459-bd00-fb9bdb246dd8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:38.135627 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1e4ad584-99d4-4459-bd00-fb9bdb246dd8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.225797 Jun 15 15:50:38.136240 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 56/113] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:37 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:38.281112 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3f06398d-59ed-4844-a003-489ae77ab01c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:38.289130 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3f06398d-59ed-4844-a003-489ae77ab01c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.222199 Jun 15 15:50:38.289703 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 58/114] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:38 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:38.418865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-168c686a-375a-4fd8-bd7f-1b5bae79ca06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:38.419576 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-168c686a-375a-4fd8-bd7f-1b5bae79ca06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:38.425949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-168c686a-375a-4fd8-bd7f-1b5bae79ca06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:38.429083 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-168c686a-375a-4fd8-bd7f-1b5bae79ca06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:38.429945 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-168c686a-375a-4fd8-bd7f-1b5bae79ca06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:38.430318 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-168c686a-375a-4fd8-bd7f-1b5bae79ca06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:38.572289 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-168c686a-375a-4fd8-bd7f-1b5bae79ca06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:38.580300 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-168c686a-375a-4fd8-bd7f-1b5bae79ca06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.165589 Jun 15 15:50:38.580957 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 57/115] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:38 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:38.958234 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f4baba3e-f20a-44fa-818f-b69fa4eb374e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:38.959050 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f4baba3e-f20a-44fa-818f-b69fa4eb374e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:38.965505 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f4baba3e-f20a-44fa-818f-b69fa4eb374e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:38.966056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f4baba3e-f20a-44fa-818f-b69fa4eb374e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:38.966953 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f4baba3e-f20a-44fa-818f-b69fa4eb374e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:38.967398 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f4baba3e-f20a-44fa-818f-b69fa4eb374e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:39.111432 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f4baba3e-f20a-44fa-818f-b69fa4eb374e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:39.119327 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f4baba3e-f20a-44fa-818f-b69fa4eb374e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:39.120820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f4baba3e-f20a-44fa-818f-b69fa4eb374e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:39.121906 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f4baba3e-f20a-44fa-818f-b69fa4eb374e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.167892 Jun 15 15:50:39.122454 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 59/116] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:38 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:39.152624 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-96f50513-fa51-4986-bc22-562fb52e0811 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:39.153225 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-96f50513-fa51-4986-bc22-562fb52e0811 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:39.159281 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-96f50513-fa51-4986-bc22-562fb52e0811 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:39.159722 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-96f50513-fa51-4986-bc22-562fb52e0811 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:39.160470 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-96f50513-fa51-4986-bc22-562fb52e0811 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:39.160920 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-96f50513-fa51-4986-bc22-562fb52e0811 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:39.293006 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-96f50513-fa51-4986-bc22-562fb52e0811 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:39.305225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-33da11a5-3268-45c2-830d-ef8ca9bfe322 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:39.305917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-33da11a5-3268-45c2-830d-ef8ca9bfe322 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:39.309337 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-96f50513-fa51-4986-bc22-562fb52e0811 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.160480 Jun 15 15:50:39.309980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 58/117] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:39 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:39.313444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33da11a5-3268-45c2-830d-ef8ca9bfe322 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:39.313923 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33da11a5-3268-45c2-830d-ef8ca9bfe322 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:39.314876 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33da11a5-3268-45c2-830d-ef8ca9bfe322 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:39.315343 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33da11a5-3268-45c2-830d-ef8ca9bfe322 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:39.454910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-33da11a5-3268-45c2-830d-ef8ca9bfe322 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:39.462541 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-33da11a5-3268-45c2-830d-ef8ca9bfe322 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.160994 Jun 15 15:50:39.466800 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 60/118] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:39 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:39.597566 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b6a943c0-54ca-466f-a97d-1d022f25b4e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:39.598564 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b6a943c0-54ca-466f-a97d-1d022f25b4e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:39.605308 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b6a943c0-54ca-466f-a97d-1d022f25b4e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:39.606041 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b6a943c0-54ca-466f-a97d-1d022f25b4e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:39.607048 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b6a943c0-54ca-466f-a97d-1d022f25b4e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:39.607488 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b6a943c0-54ca-466f-a97d-1d022f25b4e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:39.744296 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b6a943c0-54ca-466f-a97d-1d022f25b4e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:39.752860 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b6a943c0-54ca-466f-a97d-1d022f25b4e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.159316 Jun 15 15:50:39.754799 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 59/119] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:39 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:40.144193 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2096faf3-c3a0-41b5-994a-a8e1038d023b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:40.144844 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2096faf3-c3a0-41b5-994a-a8e1038d023b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:40.156492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2096faf3-c3a0-41b5-994a-a8e1038d023b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:40.157088 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2096faf3-c3a0-41b5-994a-a8e1038d023b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:40.157871 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2096faf3-c3a0-41b5-994a-a8e1038d023b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:40.158309 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2096faf3-c3a0-41b5-994a-a8e1038d023b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:40.294098 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-1a45f533-4f85-4c1a-9001-a1147d5b2b98 req-3fd26fa9-0131-46db-b2af-c9a6bff46b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876e0580-8662-495b-8d2b-99ca8643a1ca", "name": "network-vif-plugged", "status": "completed", "tag": "06cd31d6-3f6b-426a-bec7-4508a878ff64"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:40.303245 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-1a45f533-4f85-4c1a-9001-a1147d5b2b98 req-3fd26fa9-0131-46db-b2af-c9a6bff46b0f service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:40.303682 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-1a45f533-4f85-4c1a-9001-a1147d5b2b98 req-3fd26fa9-0131-46db-b2af-c9a6bff46b0f service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:40.315145 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-1a45f533-4f85-4c1a-9001-a1147d5b2b98 req-3fd26fa9-0131-46db-b2af-c9a6bff46b0f service nova] Creating event network-vif-plugged:06cd31d6-3f6b-426a-bec7-4508a878ff64 for instance 876e0580-8662-495b-8d2b-99ca8643a1ca on hv-cinder-84599 Jun 15 15:50:40.320115 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-1a45f533-4f85-4c1a-9001-a1147d5b2b98 req-3fd26fa9-0131-46db-b2af-c9a6bff46b0f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126832 Jun 15 15:50:40.322123 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 60/120] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:50:40.328157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b8e0f7c4-abd3-44b8-94a6-396ba4656d75 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:40.328842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b8e0f7c4-abd3-44b8-94a6-396ba4656d75 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:40.332191 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2096faf3-c3a0-41b5-994a-a8e1038d023b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:40.335662 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b8e0f7c4-abd3-44b8-94a6-396ba4656d75 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:40.336106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b8e0f7c4-abd3-44b8-94a6-396ba4656d75 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:40.336901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b8e0f7c4-abd3-44b8-94a6-396ba4656d75 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:40.337349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b8e0f7c4-abd3-44b8-94a6-396ba4656d75 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:40.340626 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2096faf3-c3a0-41b5-994a-a8e1038d023b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:40.342265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2096faf3-c3a0-41b5-994a-a8e1038d023b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:40.344033 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2096faf3-c3a0-41b5-994a-a8e1038d023b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.207160 Jun 15 15:50:40.344663 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 61/121] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:40 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:40.469785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b8e0f7c4-abd3-44b8-94a6-396ba4656d75 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:40.477283 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b8e0f7c4-abd3-44b8-94a6-396ba4656d75 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.153259 Jun 15 15:50:40.478016 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 61/122] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:40 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:40.478953 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c180485b-34a2-4b06-98da-eeeba63be6ad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:40.479571 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c180485b-34a2-4b06-98da-eeeba63be6ad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:40.485517 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c180485b-34a2-4b06-98da-eeeba63be6ad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:40.485967 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c180485b-34a2-4b06-98da-eeeba63be6ad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:40.486749 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c180485b-34a2-4b06-98da-eeeba63be6ad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:40.487193 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c180485b-34a2-4b06-98da-eeeba63be6ad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:40.621520 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c180485b-34a2-4b06-98da-eeeba63be6ad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:40.628909 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c180485b-34a2-4b06-98da-eeeba63be6ad tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.153851 Jun 15 15:50:40.629460 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 62/123] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:40 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:40.769977 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dbcf8b87-49d1-4e83-b60e-16fc6cb34bb4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:40.770676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-dbcf8b87-49d1-4e83-b60e-16fc6cb34bb4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:40.776828 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbcf8b87-49d1-4e83-b60e-16fc6cb34bb4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:40.777319 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbcf8b87-49d1-4e83-b60e-16fc6cb34bb4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:40.778117 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbcf8b87-49d1-4e83-b60e-16fc6cb34bb4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:40.778708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbcf8b87-49d1-4e83-b60e-16fc6cb34bb4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:40.923485 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dbcf8b87-49d1-4e83-b60e-16fc6cb34bb4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:40.931135 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-dbcf8b87-49d1-4e83-b60e-16fc6cb34bb4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.165068 Jun 15 15:50:40.931668 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 62/124] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:40 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:41.362895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f6c35a9c-49a7-44df-9e28-dae51105f8f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:41.363500 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f6c35a9c-49a7-44df-9e28-dae51105f8f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:41.369483 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f6c35a9c-49a7-44df-9e28-dae51105f8f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:41.369943 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f6c35a9c-49a7-44df-9e28-dae51105f8f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:41.370698 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f6c35a9c-49a7-44df-9e28-dae51105f8f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:41.371216 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f6c35a9c-49a7-44df-9e28-dae51105f8f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:41.493688 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-82612425-31cb-417c-b679-755c80b0c580 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:41.494605 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-82612425-31cb-417c-b679-755c80b0c580 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:41.503643 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-82612425-31cb-417c-b679-755c80b0c580 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:41.504642 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-82612425-31cb-417c-b679-755c80b0c580 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:41.505667 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-82612425-31cb-417c-b679-755c80b0c580 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:41.514247 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-82612425-31cb-417c-b679-755c80b0c580 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:41.524365 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f6c35a9c-49a7-44df-9e28-dae51105f8f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:41.538883 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f6c35a9c-49a7-44df-9e28-dae51105f8f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:41.540996 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f6c35a9c-49a7-44df-9e28-dae51105f8f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:41.545596 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f6c35a9c-49a7-44df-9e28-dae51105f8f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.186144 Jun 15 15:50:41.549546 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 63/125] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:41 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:41.645337 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-acf40340-a45a-4ae6-9a25-92bec54160b5 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:41.646214 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-acf40340-a45a-4ae6-9a25-92bec54160b5 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:41.652998 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-acf40340-a45a-4ae6-9a25-92bec54160b5 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:41.653935 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-acf40340-a45a-4ae6-9a25-92bec54160b5 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:41.658814 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-acf40340-a45a-4ae6-9a25-92bec54160b5 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:41.659519 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-acf40340-a45a-4ae6-9a25-92bec54160b5 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:41.800912 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-82612425-31cb-417c-b679-755c80b0c580 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:41.812584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-82612425-31cb-417c-b679-755c80b0c580 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.322949 Jun 15 15:50:41.813263 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 63/126] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:41 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:41.839290 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-acf40340-a45a-4ae6-9a25-92bec54160b5 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:41.851089 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-acf40340-a45a-4ae6-9a25-92bec54160b5 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.209303 Jun 15 15:50:41.851668 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 64/127] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:41 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:41.949778 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-fb652129-29f2-4ee0-93b9-470e4cbb35f6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:41.950512 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-fb652129-29f2-4ee0-93b9-470e4cbb35f6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:41.957888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fb652129-29f2-4ee0-93b9-470e4cbb35f6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:41.958513 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fb652129-29f2-4ee0-93b9-470e4cbb35f6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:41.959469 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fb652129-29f2-4ee0-93b9-470e4cbb35f6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:41.960045 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fb652129-29f2-4ee0-93b9-470e4cbb35f6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:42.170376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fb652129-29f2-4ee0-93b9-470e4cbb35f6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:42.181163 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fb652129-29f2-4ee0-93b9-470e4cbb35f6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.235357 Jun 15 15:50:42.182939 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 64/128] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:41 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:42.337814 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-82d57f9b-f7dd-4105-b382-333508decd49 req-b0eb3b84-029b-4bc5-8a33-953c495c3ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e67259e-9dd3-4875-9185-fa11291a54d9", "name": "network-vif-plugged", "status": "completed", "tag": "a85add08-672c-4dce-8f28-ed6c32fa8484"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:42.347958 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-82d57f9b-f7dd-4105-b382-333508decd49 req-b0eb3b84-029b-4bc5-8a33-953c495c3ff9 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:42.348775 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-82d57f9b-f7dd-4105-b382-333508decd49 req-b0eb3b84-029b-4bc5-8a33-953c495c3ff9 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:42.362005 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-82d57f9b-f7dd-4105-b382-333508decd49 req-b0eb3b84-029b-4bc5-8a33-953c495c3ff9 service nova] Creating event network-vif-plugged:a85add08-672c-4dce-8f28-ed6c32fa8484 for instance 9e67259e-9dd3-4875-9185-fa11291a54d9 on hv-cinder-84599 Jun 15 15:50:42.371687 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-82d57f9b-f7dd-4105-b382-333508decd49 req-b0eb3b84-029b-4bc5-8a33-953c495c3ff9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037785 Jun 15 15:50:42.375935 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 65/129] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:42.565877 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-822c1d53-cc24-46d8-991a-35c4cf651d2a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:42.566485 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-822c1d53-cc24-46d8-991a-35c4cf651d2a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:42.573095 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-822c1d53-cc24-46d8-991a-35c4cf651d2a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:42.573267 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-822c1d53-cc24-46d8-991a-35c4cf651d2a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:42.574151 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-822c1d53-cc24-46d8-991a-35c4cf651d2a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:42.574773 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-822c1d53-cc24-46d8-991a-35c4cf651d2a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:42.741080 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-822c1d53-cc24-46d8-991a-35c4cf651d2a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:42.744970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:42.752056 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-822c1d53-cc24-46d8-991a-35c4cf651d2a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:42.753741 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-822c1d53-cc24-46d8-991a-35c4cf651d2a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:42.754858 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-822c1d53-cc24-46d8-991a-35c4cf651d2a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.193447 Jun 15 15:50:42.755404 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 65/130] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:42 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:42.832199 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c0a95814-40dc-4406-8e0e-8ab395a3ee17 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:42.832899 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c0a95814-40dc-4406-8e0e-8ab395a3ee17 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:42.847086 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c0a95814-40dc-4406-8e0e-8ab395a3ee17 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:42.847788 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c0a95814-40dc-4406-8e0e-8ab395a3ee17 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:42.849131 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c0a95814-40dc-4406-8e0e-8ab395a3ee17 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:42.849750 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c0a95814-40dc-4406-8e0e-8ab395a3ee17 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:42.869862 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d1065c1a-99a1-4582-aff0-539aae43eed4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:42.870630 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d1065c1a-99a1-4582-aff0-539aae43eed4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:42.882319 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1065c1a-99a1-4582-aff0-539aae43eed4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:42.883760 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1065c1a-99a1-4582-aff0-539aae43eed4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:42.885522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1065c1a-99a1-4582-aff0-539aae43eed4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:42.887346 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1065c1a-99a1-4582-aff0-539aae43eed4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:43.324422 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d1065c1a-99a1-4582-aff0-539aae43eed4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:43.334043 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d1065c1a-99a1-4582-aff0-539aae43eed4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.468513 Jun 15 15:50:43.344004 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 66/131] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:42 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:43.353723 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-48b79aa4-3e23-4edf-9f6a-798b43613835 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:43.354578 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-48b79aa4-3e23-4edf-9f6a-798b43613835 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:43.361074 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48b79aa4-3e23-4edf-9f6a-798b43613835 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:43.361763 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48b79aa4-3e23-4edf-9f6a-798b43613835 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:43.362681 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48b79aa4-3e23-4edf-9f6a-798b43613835 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:43.363670 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48b79aa4-3e23-4edf-9f6a-798b43613835 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:43.428230 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c0a95814-40dc-4406-8e0e-8ab395a3ee17 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:43.463336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c0a95814-40dc-4406-8e0e-8ab395a3ee17 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.635649 Jun 15 15:50:43.465854 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 66/132] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:42 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:43.773534 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-eac8cf2a-5090-42cc-805b-101ac53d676b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:43.774708 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-eac8cf2a-5090-42cc-805b-101ac53d676b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:43.789765 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eac8cf2a-5090-42cc-805b-101ac53d676b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:43.790548 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eac8cf2a-5090-42cc-805b-101ac53d676b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:43.791818 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eac8cf2a-5090-42cc-805b-101ac53d676b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:43.792485 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eac8cf2a-5090-42cc-805b-101ac53d676b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:43.794566 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-48b79aa4-3e23-4edf-9f6a-798b43613835 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:43.812115 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-48b79aa4-3e23-4edf-9f6a-798b43613835 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.465959 Jun 15 15:50:43.812742 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 67/133] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:43 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:43.946696 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-eac8cf2a-5090-42cc-805b-101ac53d676b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:43.951129 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=100 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:43.957645 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-eac8cf2a-5090-42cc-805b-101ac53d676b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:43.959265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-eac8cf2a-5090-42cc-805b-101ac53d676b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:43.960383 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-eac8cf2a-5090-42cc-805b-101ac53d676b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.190770 Jun 15 15:50:43.960974 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 67/134] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:43 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:50:44.361164 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-42e3dae9-230a-4aa5-8bf4-e969b1e71ba8 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:44.361898 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-42e3dae9-230a-4aa5-8bf4-e969b1e71ba8 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:44.375294 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-42e3dae9-230a-4aa5-8bf4-e969b1e71ba8 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:44.376019 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-42e3dae9-230a-4aa5-8bf4-e969b1e71ba8 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:44.377713 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-42e3dae9-230a-4aa5-8bf4-e969b1e71ba8 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:44.378624 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-42e3dae9-230a-4aa5-8bf4-e969b1e71ba8 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:44.481899 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9a8e1d92-be78-46e6-bde1-5054a8a55807 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:44.482579 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9a8e1d92-be78-46e6-bde1-5054a8a55807 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:44.490432 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9a8e1d92-be78-46e6-bde1-5054a8a55807 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:44.491276 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9a8e1d92-be78-46e6-bde1-5054a8a55807 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:44.495481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9a8e1d92-be78-46e6-bde1-5054a8a55807 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:44.496283 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9a8e1d92-be78-46e6-bde1-5054a8a55807 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:44.543644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-42e3dae9-230a-4aa5-8bf4-e969b1e71ba8 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:44.573771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-42e3dae9-230a-4aa5-8bf4-e969b1e71ba8 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.225733 Jun 15 15:50:44.575728 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 68/135] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:44 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:44.707147 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9a8e1d92-be78-46e6-bde1-5054a8a55807 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:44.720570 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9a8e1d92-be78-46e6-bde1-5054a8a55807 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.242469 Jun 15 15:50:44.730830 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 68/136] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:44 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:44.830724 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-eed65eb4-1370-4241-9ce7-b7f3690acd6b tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:44.832053 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-eed65eb4-1370-4241-9ce7-b7f3690acd6b tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:44.845582 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eed65eb4-1370-4241-9ce7-b7f3690acd6b tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:44.846881 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eed65eb4-1370-4241-9ce7-b7f3690acd6b tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:44.847667 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eed65eb4-1370-4241-9ce7-b7f3690acd6b tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:44.850420 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eed65eb4-1370-4241-9ce7-b7f3690acd6b tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:44.982854 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4e8fe4e2-6a5f-488d-a4d4-da227594708e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:44.984256 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4e8fe4e2-6a5f-488d-a4d4-da227594708e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:44.994581 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4e8fe4e2-6a5f-488d-a4d4-da227594708e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:44.995402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4e8fe4e2-6a5f-488d-a4d4-da227594708e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:44.996408 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4e8fe4e2-6a5f-488d-a4d4-da227594708e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:44.997051 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4e8fe4e2-6a5f-488d-a4d4-da227594708e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:45.035909 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-eed65eb4-1370-4241-9ce7-b7f3690acd6b tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:45.044530 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-eed65eb4-1370-4241-9ce7-b7f3690acd6b tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.218762 Jun 15 15:50:45.054377 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 69/137] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:44 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:45.180722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4e8fe4e2-6a5f-488d-a4d4-da227594708e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:45.191308 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4e8fe4e2-6a5f-488d-a4d4-da227594708e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:45.193275 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4e8fe4e2-6a5f-488d-a4d4-da227594708e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:45.194617 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4e8fe4e2-6a5f-488d-a4d4-da227594708e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.220368 Jun 15 15:50:45.195540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 69/138] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:44 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:45.592266 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b26bc159-d08f-4a16-b5f4-c5ed838f9e53 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:45.593355 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b26bc159-d08f-4a16-b5f4-c5ed838f9e53 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:45.599804 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b26bc159-d08f-4a16-b5f4-c5ed838f9e53 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:45.600423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b26bc159-d08f-4a16-b5f4-c5ed838f9e53 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:45.601368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b26bc159-d08f-4a16-b5f4-c5ed838f9e53 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:45.601801 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b26bc159-d08f-4a16-b5f4-c5ed838f9e53 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:45.747918 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-562887d5-d5a7-4994-9b23-877817152db2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:45.748612 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-562887d5-d5a7-4994-9b23-877817152db2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:45.755423 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-562887d5-d5a7-4994-9b23-877817152db2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:45.756157 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-562887d5-d5a7-4994-9b23-877817152db2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:45.756350 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b26bc159-d08f-4a16-b5f4-c5ed838f9e53 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:45.757275 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-562887d5-d5a7-4994-9b23-877817152db2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:45.757857 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-562887d5-d5a7-4994-9b23-877817152db2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:45.768514 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b26bc159-d08f-4a16-b5f4-c5ed838f9e53 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.180046 Jun 15 15:50:45.778228 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 70/139] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:45 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:45.907978 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-562887d5-d5a7-4994-9b23-877817152db2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:45.916754 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-562887d5-d5a7-4994-9b23-877817152db2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.173194 Jun 15 15:50:45.917340 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 70/140] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:45 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:46.064955 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-17b1aec0-143f-405c-872c-43f8386e6bdc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:46.066514 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-17b1aec0-143f-405c-872c-43f8386e6bdc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:46.078913 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17b1aec0-143f-405c-872c-43f8386e6bdc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:46.079613 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17b1aec0-143f-405c-872c-43f8386e6bdc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:46.080326 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17b1aec0-143f-405c-872c-43f8386e6bdc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:46.080913 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17b1aec0-143f-405c-872c-43f8386e6bdc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:46.214212 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3facea9e-52fb-48c0-8a58-5d7ff149dc1b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:46.215070 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3facea9e-52fb-48c0-8a58-5d7ff149dc1b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:46.221733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3facea9e-52fb-48c0-8a58-5d7ff149dc1b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:46.222405 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3facea9e-52fb-48c0-8a58-5d7ff149dc1b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:46.223204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3facea9e-52fb-48c0-8a58-5d7ff149dc1b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:46.223949 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3facea9e-52fb-48c0-8a58-5d7ff149dc1b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:46.240089 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-17b1aec0-143f-405c-872c-43f8386e6bdc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:46.250640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-17b1aec0-143f-405c-872c-43f8386e6bdc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.192312 Jun 15 15:50:46.251381 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 71/141] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:46 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:46.422476 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3facea9e-52fb-48c0-8a58-5d7ff149dc1b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:46.446002 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3facea9e-52fb-48c0-8a58-5d7ff149dc1b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:46.448202 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3facea9e-52fb-48c0-8a58-5d7ff149dc1b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:46.449790 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3facea9e-52fb-48c0-8a58-5d7ff149dc1b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.240284 Jun 15 15:50:46.464553 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 71/142] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:46 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:50:46.562653 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-1cc15b50-4643-45c2-b8dd-98bb400f7f46 req-f448002c-938b-4947-b4fd-8bbf779f3ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ff33fe-05bf-4bd5-9159-69805bae0aed", "name": "network-vif-plugged", "status": "completed", "tag": "229f5bd2-2de2-41f9-ac9f-ef6b3af254d6"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:50:46.573505 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-1cc15b50-4643-45c2-b8dd-98bb400f7f46 req-f448002c-938b-4947-b4fd-8bbf779f3ed6 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:46.574271 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-1cc15b50-4643-45c2-b8dd-98bb400f7f46 req-f448002c-938b-4947-b4fd-8bbf779f3ed6 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:46.588609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-1cc15b50-4643-45c2-b8dd-98bb400f7f46 req-f448002c-938b-4947-b4fd-8bbf779f3ed6 service nova] Creating event network-vif-plugged:229f5bd2-2de2-41f9-ac9f-ef6b3af254d6 for instance c8ff33fe-05bf-4bd5-9159-69805bae0aed on hv-cinder-84599 Jun 15 15:50:46.595169 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-1cc15b50-4643-45c2-b8dd-98bb400f7f46 req-f448002c-938b-4947-b4fd-8bbf779f3ed6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037084 Jun 15 15:50:46.596025 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 72/143] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:50:46.789296 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5fd9142d-2f64-4724-bb09-d515ac16ed96 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:46.789905 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5fd9142d-2f64-4724-bb09-d515ac16ed96 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:46.803663 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5fd9142d-2f64-4724-bb09-d515ac16ed96 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:46.803663 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5fd9142d-2f64-4724-bb09-d515ac16ed96 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:46.803663 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5fd9142d-2f64-4724-bb09-d515ac16ed96 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:46.803663 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5fd9142d-2f64-4724-bb09-d515ac16ed96 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:46.938015 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c326326d-a734-4885-b9a5-bc14cf5d0b77 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:46.939171 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c326326d-a734-4885-b9a5-bc14cf5d0b77 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:46.947029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c326326d-a734-4885-b9a5-bc14cf5d0b77 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:46.947562 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c326326d-a734-4885-b9a5-bc14cf5d0b77 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:46.948403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c326326d-a734-4885-b9a5-bc14cf5d0b77 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:46.948909 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c326326d-a734-4885-b9a5-bc14cf5d0b77 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:46.988978 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5fd9142d-2f64-4724-bb09-d515ac16ed96 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:47.000406 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5fd9142d-2f64-4724-bb09-d515ac16ed96 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.215092 Jun 15 15:50:47.001003 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 72/144] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:46 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:47.086324 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c326326d-a734-4885-b9a5-bc14cf5d0b77 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:47.093753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c326326d-a734-4885-b9a5-bc14cf5d0b77 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.161601 Jun 15 15:50:47.094313 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 73/145] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:46 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:47.268049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2e55ac12-af2f-4d7d-83e4-24f3550b0b97 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:47.268574 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2e55ac12-af2f-4d7d-83e4-24f3550b0b97 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:47.275535 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2e55ac12-af2f-4d7d-83e4-24f3550b0b97 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:47.276171 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2e55ac12-af2f-4d7d-83e4-24f3550b0b97 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:47.277146 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2e55ac12-af2f-4d7d-83e4-24f3550b0b97 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:47.277648 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2e55ac12-af2f-4d7d-83e4-24f3550b0b97 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:47.412461 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2e55ac12-af2f-4d7d-83e4-24f3550b0b97 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:47.420031 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2e55ac12-af2f-4d7d-83e4-24f3550b0b97 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.156119 Jun 15 15:50:47.420590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 73/146] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:47 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:47.468753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a83247cd-abb1-4839-9b2a-63d3591ea993 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:47.469402 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a83247cd-abb1-4839-9b2a-63d3591ea993 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:47.476259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a83247cd-abb1-4839-9b2a-63d3591ea993 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:47.476712 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a83247cd-abb1-4839-9b2a-63d3591ea993 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:47.477486 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a83247cd-abb1-4839-9b2a-63d3591ea993 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:47.477920 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a83247cd-abb1-4839-9b2a-63d3591ea993 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:47.613594 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a83247cd-abb1-4839-9b2a-63d3591ea993 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:47.622651 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a83247cd-abb1-4839-9b2a-63d3591ea993 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:47.624287 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a83247cd-abb1-4839-9b2a-63d3591ea993 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:47.625632 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a83247cd-abb1-4839-9b2a-63d3591ea993 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.160874 Jun 15 15:50:47.626190 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 74/147] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:47 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:48.017819 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-207b80c8-6c0a-4702-ada7-f9c501444d5b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:48.018438 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-207b80c8-6c0a-4702-ada7-f9c501444d5b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:48.024647 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-207b80c8-6c0a-4702-ada7-f9c501444d5b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:48.025094 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-207b80c8-6c0a-4702-ada7-f9c501444d5b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:48.025866 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-207b80c8-6c0a-4702-ada7-f9c501444d5b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:48.026299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-207b80c8-6c0a-4702-ada7-f9c501444d5b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:48.111379 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5fd725d9-bf3f-4ff8-88d7-f66828db120e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:48.112010 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5fd725d9-bf3f-4ff8-88d7-f66828db120e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:48.118198 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5fd725d9-bf3f-4ff8-88d7-f66828db120e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:48.118644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5fd725d9-bf3f-4ff8-88d7-f66828db120e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:48.119452 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5fd725d9-bf3f-4ff8-88d7-f66828db120e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:48.119888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5fd725d9-bf3f-4ff8-88d7-f66828db120e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:48.168453 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-207b80c8-6c0a-4702-ada7-f9c501444d5b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:48.176570 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-207b80c8-6c0a-4702-ada7-f9c501444d5b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.163094 Jun 15 15:50:48.177138 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 74/148] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:48 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:48.247359 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5fd725d9-bf3f-4ff8-88d7-f66828db120e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:48.255297 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5fd725d9-bf3f-4ff8-88d7-f66828db120e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.148839 Jun 15 15:50:48.255853 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 75/149] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:48 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:48.437253 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c72b7cca-c0fb-45a3-87d9-a0dc1dad4bbf tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:48.437862 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c72b7cca-c0fb-45a3-87d9-a0dc1dad4bbf tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:48.443885 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c72b7cca-c0fb-45a3-87d9-a0dc1dad4bbf tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:48.444339 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c72b7cca-c0fb-45a3-87d9-a0dc1dad4bbf tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:48.445105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c72b7cca-c0fb-45a3-87d9-a0dc1dad4bbf tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:48.445538 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c72b7cca-c0fb-45a3-87d9-a0dc1dad4bbf tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:48.568381 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c72b7cca-c0fb-45a3-87d9-a0dc1dad4bbf tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:48.575878 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c72b7cca-c0fb-45a3-87d9-a0dc1dad4bbf tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.142455 Jun 15 15:50:48.576450 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 75/150] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:48 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:48.643376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-71d40706-4d44-4bf6-a0bf-20984f965fb2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:48.643982 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-71d40706-4d44-4bf6-a0bf-20984f965fb2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:48.649865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-71d40706-4d44-4bf6-a0bf-20984f965fb2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:48.650311 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-71d40706-4d44-4bf6-a0bf-20984f965fb2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:48.651093 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-71d40706-4d44-4bf6-a0bf-20984f965fb2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:48.651526 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-71d40706-4d44-4bf6-a0bf-20984f965fb2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:48.793245 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-71d40706-4d44-4bf6-a0bf-20984f965fb2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:48.801570 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-71d40706-4d44-4bf6-a0bf-20984f965fb2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:48.803097 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-71d40706-4d44-4bf6-a0bf-20984f965fb2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:48.804193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-71d40706-4d44-4bf6-a0bf-20984f965fb2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.164797 Jun 15 15:50:48.804750 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 76/151] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:48 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:49.194285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-227886aa-5f0a-42ce-8496-cccc5b5ce5ed tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:49.194976 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-227886aa-5f0a-42ce-8496-cccc5b5ce5ed tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:49.201121 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-227886aa-5f0a-42ce-8496-cccc5b5ce5ed tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:49.201634 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-227886aa-5f0a-42ce-8496-cccc5b5ce5ed tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:49.203060 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-227886aa-5f0a-42ce-8496-cccc5b5ce5ed tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:49.203487 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-227886aa-5f0a-42ce-8496-cccc5b5ce5ed tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:49.272856 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5c4b8308-f0d4-4534-a0a1-9106aae1be88 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:49.273513 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5c4b8308-f0d4-4534-a0a1-9106aae1be88 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:49.279576 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5c4b8308-f0d4-4534-a0a1-9106aae1be88 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:49.280012 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5c4b8308-f0d4-4534-a0a1-9106aae1be88 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:49.280765 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5c4b8308-f0d4-4534-a0a1-9106aae1be88 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:49.281223 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5c4b8308-f0d4-4534-a0a1-9106aae1be88 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:49.361249 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-227886aa-5f0a-42ce-8496-cccc5b5ce5ed tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:49.368684 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-227886aa-5f0a-42ce-8496-cccc5b5ce5ed tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.178797 Jun 15 15:50:49.369242 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 76/152] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:49 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:49.427765 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5c4b8308-f0d4-4534-a0a1-9106aae1be88 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:49.442235 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5c4b8308-f0d4-4534-a0a1-9106aae1be88 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.173201 Jun 15 15:50:49.442850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 77/153] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:49 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:49.592335 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-16a080fa-c23c-4f84-a93a-bd43d36f7752 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:49.592883 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-16a080fa-c23c-4f84-a93a-bd43d36f7752 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:49.598949 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-16a080fa-c23c-4f84-a93a-bd43d36f7752 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:49.599405 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-16a080fa-c23c-4f84-a93a-bd43d36f7752 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:49.600169 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-16a080fa-c23c-4f84-a93a-bd43d36f7752 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:49.600613 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-16a080fa-c23c-4f84-a93a-bd43d36f7752 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:49.731931 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-16a080fa-c23c-4f84-a93a-bd43d36f7752 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:49.744685 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-16a080fa-c23c-4f84-a93a-bd43d36f7752 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.155280 Jun 15 15:50:49.744685 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 77/154] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:49 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:49.822106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-469e9628-0e39-4b37-803f-054a10ab5aa4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:49.822707 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-469e9628-0e39-4b37-803f-054a10ab5aa4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:49.830620 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-469e9628-0e39-4b37-803f-054a10ab5aa4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:49.831164 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-469e9628-0e39-4b37-803f-054a10ab5aa4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:49.833348 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-469e9628-0e39-4b37-803f-054a10ab5aa4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:49.834905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-469e9628-0e39-4b37-803f-054a10ab5aa4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:49.972166 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-469e9628-0e39-4b37-803f-054a10ab5aa4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:49.981765 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-469e9628-0e39-4b37-803f-054a10ab5aa4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:49.983307 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-469e9628-0e39-4b37-803f-054a10ab5aa4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:49.984977 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-469e9628-0e39-4b37-803f-054a10ab5aa4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.166779 Jun 15 15:50:49.985533 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 78/155] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:49 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:50.385941 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-606c387d-1ea0-4851-a11a-b380d8065d6a tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:50.386553 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-606c387d-1ea0-4851-a11a-b380d8065d6a tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:50.393311 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-606c387d-1ea0-4851-a11a-b380d8065d6a tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:50.393758 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-606c387d-1ea0-4851-a11a-b380d8065d6a tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:50.394542 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-606c387d-1ea0-4851-a11a-b380d8065d6a tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:50.394998 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-606c387d-1ea0-4851-a11a-b380d8065d6a tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:50.459379 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-935b49e1-85e0-4d2c-8bc1-f8745cd4198a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:50.460073 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-935b49e1-85e0-4d2c-8bc1-f8745cd4198a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:50.466119 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-935b49e1-85e0-4d2c-8bc1-f8745cd4198a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:50.466639 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-935b49e1-85e0-4d2c-8bc1-f8745cd4198a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:50.467492 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-935b49e1-85e0-4d2c-8bc1-f8745cd4198a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:50.468577 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-935b49e1-85e0-4d2c-8bc1-f8745cd4198a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:50.549568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-606c387d-1ea0-4851-a11a-b380d8065d6a tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:50.557093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-606c387d-1ea0-4851-a11a-b380d8065d6a tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.174841 Jun 15 15:50:50.557673 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 78/156] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:50 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:50.607887 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-935b49e1-85e0-4d2c-8bc1-f8745cd4198a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:50.616020 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-935b49e1-85e0-4d2c-8bc1-f8745cd4198a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.160403 Jun 15 15:50:50.616603 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 79/157] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:50 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:50.761657 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5ce95832-40d0-477f-b33a-7336a10c0795 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:50.762183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5ce95832-40d0-477f-b33a-7336a10c0795 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:50.769058 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ce95832-40d0-477f-b33a-7336a10c0795 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:50.769509 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ce95832-40d0-477f-b33a-7336a10c0795 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:50.770278 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ce95832-40d0-477f-b33a-7336a10c0795 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:50.770706 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ce95832-40d0-477f-b33a-7336a10c0795 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:50.897872 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5ce95832-40d0-477f-b33a-7336a10c0795 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:50.905456 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5ce95832-40d0-477f-b33a-7336a10c0795 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.147672 Jun 15 15:50:50.906035 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 79/158] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:50 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:51.004969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f8d2b473-e9a2-4c0c-8db8-a9f92842195b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:51.005597 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f8d2b473-e9a2-4c0c-8db8-a9f92842195b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:51.011726 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f8d2b473-e9a2-4c0c-8db8-a9f92842195b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:51.012101 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f8d2b473-e9a2-4c0c-8db8-a9f92842195b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:51.012850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f8d2b473-e9a2-4c0c-8db8-a9f92842195b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:51.013273 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f8d2b473-e9a2-4c0c-8db8-a9f92842195b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:51.137633 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f8d2b473-e9a2-4c0c-8db8-a9f92842195b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:51.147144 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f8d2b473-e9a2-4c0c-8db8-a9f92842195b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:51.148656 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f8d2b473-e9a2-4c0c-8db8-a9f92842195b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:51.149752 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f8d2b473-e9a2-4c0c-8db8-a9f92842195b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.148604 Jun 15 15:50:51.150301 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 80/159] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:51 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:51.573890 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-83f52a45-8f5c-415a-9ef7-bc700353d2c0 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:51.574522 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-83f52a45-8f5c-415a-9ef7-bc700353d2c0 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:51.580543 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-83f52a45-8f5c-415a-9ef7-bc700353d2c0 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:51.580985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-83f52a45-8f5c-415a-9ef7-bc700353d2c0 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:51.581747 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-83f52a45-8f5c-415a-9ef7-bc700353d2c0 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:51.582177 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-83f52a45-8f5c-415a-9ef7-bc700353d2c0 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:51.632719 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7232b6a0-642b-49c4-8ef7-43dd50e917d0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:51.633339 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7232b6a0-642b-49c4-8ef7-43dd50e917d0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:51.636366 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:51.640343 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7232b6a0-642b-49c4-8ef7-43dd50e917d0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:51.640786 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7232b6a0-642b-49c4-8ef7-43dd50e917d0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:51.641544 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7232b6a0-642b-49c4-8ef7-43dd50e917d0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:51.641974 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7232b6a0-642b-49c4-8ef7-43dd50e917d0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:51.748500 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-83f52a45-8f5c-415a-9ef7-bc700353d2c0 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:51.755978 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-83f52a45-8f5c-415a-9ef7-bc700353d2c0 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.186084 Jun 15 15:50:51.756540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 80/160] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:51 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:51.792303 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7232b6a0-642b-49c4-8ef7-43dd50e917d0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:51.799824 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7232b6a0-642b-49c4-8ef7-43dd50e917d0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.170882 Jun 15 15:50:51.800391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 81/161] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:51 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:51.925551 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-70ecfe3d-57b4-4fdb-af9f-04dd3dffbac9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:51.926172 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-70ecfe3d-57b4-4fdb-af9f-04dd3dffbac9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:51.928013 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=100 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:51.933274 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70ecfe3d-57b4-4fdb-af9f-04dd3dffbac9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:51.933710 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70ecfe3d-57b4-4fdb-af9f-04dd3dffbac9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:51.934450 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70ecfe3d-57b4-4fdb-af9f-04dd3dffbac9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:51.934908 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70ecfe3d-57b4-4fdb-af9f-04dd3dffbac9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:52.059035 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-70ecfe3d-57b4-4fdb-af9f-04dd3dffbac9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:52.066282 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-70ecfe3d-57b4-4fdb-af9f-04dd3dffbac9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.144487 Jun 15 15:50:52.066859 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 81/162] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:51 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:52.167629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-10e33fe9-0cf6-435c-b1cb-712cec6646e2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:52.168242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-10e33fe9-0cf6-435c-b1cb-712cec6646e2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:52.174146 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-10e33fe9-0cf6-435c-b1cb-712cec6646e2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:52.174656 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-10e33fe9-0cf6-435c-b1cb-712cec6646e2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:52.175430 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-10e33fe9-0cf6-435c-b1cb-712cec6646e2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:52.175985 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-10e33fe9-0cf6-435c-b1cb-712cec6646e2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:52.304807 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-10e33fe9-0cf6-435c-b1cb-712cec6646e2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:52.313045 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-10e33fe9-0cf6-435c-b1cb-712cec6646e2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:52.314534 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-10e33fe9-0cf6-435c-b1cb-712cec6646e2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:52.315655 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-10e33fe9-0cf6-435c-b1cb-712cec6646e2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.152004 Jun 15 15:50:52.316208 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 82/163] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:52 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:52.772589 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6780af68-9b10-46e4-9ed1-b98ee3a9b150 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:52.773211 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6780af68-9b10-46e4-9ed1-b98ee3a9b150 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:52.779213 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6780af68-9b10-46e4-9ed1-b98ee3a9b150 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:52.779656 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6780af68-9b10-46e4-9ed1-b98ee3a9b150 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:52.780395 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6780af68-9b10-46e4-9ed1-b98ee3a9b150 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:52.780817 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6780af68-9b10-46e4-9ed1-b98ee3a9b150 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:52.816928 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9b21808c-d554-4f72-95c5-6cc934529ce6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:52.817559 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9b21808c-d554-4f72-95c5-6cc934529ce6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:52.823653 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9b21808c-d554-4f72-95c5-6cc934529ce6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:52.824096 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9b21808c-d554-4f72-95c5-6cc934529ce6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:52.824855 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9b21808c-d554-4f72-95c5-6cc934529ce6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:52.825291 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9b21808c-d554-4f72-95c5-6cc934529ce6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:52.829718 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:52.957482 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6780af68-9b10-46e4-9ed1-b98ee3a9b150 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:52.964839 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6780af68-9b10-46e4-9ed1-b98ee3a9b150 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.196069 Jun 15 15:50:52.965406 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 82/164] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:52 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:52.984736 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-9b21808c-d554-4f72-95c5-6cc934529ce6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:52.992108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9b21808c-d554-4f72-95c5-6cc934529ce6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.179053 Jun 15 15:50:52.992659 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 83/165] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:52 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:53.082604 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1a14ee70-45d0-461c-b0bd-e78e50de0afb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:53.083140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1a14ee70-45d0-461c-b0bd-e78e50de0afb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:53.089068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1a14ee70-45d0-461c-b0bd-e78e50de0afb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:53.089517 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1a14ee70-45d0-461c-b0bd-e78e50de0afb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:53.090265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1a14ee70-45d0-461c-b0bd-e78e50de0afb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:53.090695 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1a14ee70-45d0-461c-b0bd-e78e50de0afb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:53.217816 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1a14ee70-45d0-461c-b0bd-e78e50de0afb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:53.226304 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1a14ee70-45d0-461c-b0bd-e78e50de0afb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.147615 Jun 15 15:50:53.226987 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 83/166] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:53 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:53.333715 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-257f57ad-3a68-45a3-9124-fdb0125bcc03 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:53.334288 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-257f57ad-3a68-45a3-9124-fdb0125bcc03 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:53.340268 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-257f57ad-3a68-45a3-9124-fdb0125bcc03 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:53.340708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-257f57ad-3a68-45a3-9124-fdb0125bcc03 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:53.341464 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-257f57ad-3a68-45a3-9124-fdb0125bcc03 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:53.341893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-257f57ad-3a68-45a3-9124-fdb0125bcc03 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:53.470544 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-257f57ad-3a68-45a3-9124-fdb0125bcc03 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:53.478428 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-257f57ad-3a68-45a3-9124-fdb0125bcc03 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:53.479951 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-257f57ad-3a68-45a3-9124-fdb0125bcc03 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:53.481032 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-257f57ad-3a68-45a3-9124-fdb0125bcc03 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.151219 Jun 15 15:50:53.481579 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 84/167] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:53 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:53.982870 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4536d8ad-fef5-48b3-828b-5f76b96357e4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:53.983978 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4536d8ad-fef5-48b3-828b-5f76b96357e4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:53.989990 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4536d8ad-fef5-48b3-828b-5f76b96357e4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:53.990436 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4536d8ad-fef5-48b3-828b-5f76b96357e4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:53.991293 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4536d8ad-fef5-48b3-828b-5f76b96357e4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:53.991658 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4536d8ad-fef5-48b3-828b-5f76b96357e4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:54.008456 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-543baba3-84fa-478f-8836-70599701244c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:54.009060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-543baba3-84fa-478f-8836-70599701244c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:54.010009 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=100 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:50:54.014987 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-543baba3-84fa-478f-8836-70599701244c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:54.015431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-543baba3-84fa-478f-8836-70599701244c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:54.016188 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-543baba3-84fa-478f-8836-70599701244c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:54.016616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-543baba3-84fa-478f-8836-70599701244c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:54.192493 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4536d8ad-fef5-48b3-828b-5f76b96357e4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:54.199989 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4536d8ad-fef5-48b3-828b-5f76b96357e4 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1314 microversion: 2.1 time: 0.221003 Jun 15 15:50:54.200557 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 84/168] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:53 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:54.203594 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-543baba3-84fa-478f-8836-70599701244c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:54.211097 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-543baba3-84fa-478f-8836-70599701244c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.206415 Jun 15 15:50:54.211648 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 85/169] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:54 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:50:54.243920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6ac1f7fb-63c0-4adb-a70e-18f688abdf19 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:54.244458 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6ac1f7fb-63c0-4adb-a70e-18f688abdf19 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:54.251253 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6ac1f7fb-63c0-4adb-a70e-18f688abdf19 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:54.251695 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6ac1f7fb-63c0-4adb-a70e-18f688abdf19 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:54.252455 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6ac1f7fb-63c0-4adb-a70e-18f688abdf19 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:54.252918 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6ac1f7fb-63c0-4adb-a70e-18f688abdf19 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:54.391028 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6ac1f7fb-63c0-4adb-a70e-18f688abdf19 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:54.398343 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6ac1f7fb-63c0-4adb-a70e-18f688abdf19 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.158789 Jun 15 15:50:54.398931 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 85/170] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:54 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:54.498911 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4ac28559-3503-4379-a682-fe789c8d83ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:54.499437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4ac28559-3503-4379-a682-fe789c8d83ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:54.505415 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4ac28559-3503-4379-a682-fe789c8d83ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:54.505858 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4ac28559-3503-4379-a682-fe789c8d83ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:54.506600 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4ac28559-3503-4379-a682-fe789c8d83ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:54.507061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4ac28559-3503-4379-a682-fe789c8d83ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:54.632821 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4ac28559-3503-4379-a682-fe789c8d83ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:54.640662 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4ac28559-3503-4379-a682-fe789c8d83ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:54.642157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4ac28559-3503-4379-a682-fe789c8d83ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:54.643279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4ac28559-3503-4379-a682-fe789c8d83ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.148526 Jun 15 15:50:54.643827 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 86/171] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:54 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:55.216302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3dee9582-29db-42d9-928a-066f4224f16e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:55.216908 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3dee9582-29db-42d9-928a-066f4224f16e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:55.230996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-fa1472fb-5e0c-4008-a59d-e79529e38327 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:55.231616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-fa1472fb-5e0c-4008-a59d-e79529e38327 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:55.236731 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3dee9582-29db-42d9-928a-066f4224f16e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:55.237182 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3dee9582-29db-42d9-928a-066f4224f16e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:55.237964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3dee9582-29db-42d9-928a-066f4224f16e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:55.238399 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3dee9582-29db-42d9-928a-066f4224f16e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:55.245765 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fa1472fb-5e0c-4008-a59d-e79529e38327 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:55.246294 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fa1472fb-5e0c-4008-a59d-e79529e38327 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:55.247172 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fa1472fb-5e0c-4008-a59d-e79529e38327 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:55.247670 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fa1472fb-5e0c-4008-a59d-e79529e38327 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:55.443781 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3dee9582-29db-42d9-928a-066f4224f16e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:55.450105 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fa1472fb-5e0c-4008-a59d-e79529e38327 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:55.463263 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fa1472fb-5e0c-4008-a59d-e79529e38327 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.238826 Jun 15 15:50:55.463631 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3dee9582-29db-42d9-928a-066f4224f16e tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1500 microversion: 2.1 time: 0.251102 Jun 15 15:50:55.463984 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 87/172] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:55 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:55.471944 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-438fcbee-708f-4f69-820a-f5e6ebb09c41 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:55.473094 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-438fcbee-708f-4f69-820a-f5e6ebb09c41 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:55.476445 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 86/173] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:55 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1500 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:55.481126 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-438fcbee-708f-4f69-820a-f5e6ebb09c41 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:55.481614 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-438fcbee-708f-4f69-820a-f5e6ebb09c41 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:55.482458 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-438fcbee-708f-4f69-820a-f5e6ebb09c41 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:55.483121 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-438fcbee-708f-4f69-820a-f5e6ebb09c41 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:55.622824 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-438fcbee-708f-4f69-820a-f5e6ebb09c41 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:55.632475 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-438fcbee-708f-4f69-820a-f5e6ebb09c41 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.167163 Jun 15 15:50:55.633408 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 88/174] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:55 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:55.661955 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e194e64e-b6bd-4ea0-8d19-f2298be74029 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:55.662519 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e194e64e-b6bd-4ea0-8d19-f2298be74029 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:55.668470 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e194e64e-b6bd-4ea0-8d19-f2298be74029 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:55.668913 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e194e64e-b6bd-4ea0-8d19-f2298be74029 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:55.669663 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e194e64e-b6bd-4ea0-8d19-f2298be74029 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:55.670086 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e194e64e-b6bd-4ea0-8d19-f2298be74029 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:55.811586 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e194e64e-b6bd-4ea0-8d19-f2298be74029 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:55.819456 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e194e64e-b6bd-4ea0-8d19-f2298be74029 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:55.820966 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e194e64e-b6bd-4ea0-8d19-f2298be74029 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:55.822055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e194e64e-b6bd-4ea0-8d19-f2298be74029 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.164511 Jun 15 15:50:55.822608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 87/175] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:55 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:56.481065 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-43172c42-65eb-4d1e-8d55-c9f491eae487 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:56.481779 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-43172c42-65eb-4d1e-8d55-c9f491eae487 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:56.488265 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-43172c42-65eb-4d1e-8d55-c9f491eae487 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:56.488705 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-43172c42-65eb-4d1e-8d55-c9f491eae487 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:56.489459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-43172c42-65eb-4d1e-8d55-c9f491eae487 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:56.489890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-43172c42-65eb-4d1e-8d55-c9f491eae487 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:56.615431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-43172c42-65eb-4d1e-8d55-c9f491eae487 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:56.622748 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-43172c42-65eb-4d1e-8d55-c9f491eae487 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.145699 Jun 15 15:50:56.623308 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 89/176] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:56 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:56.650040 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d66c0873-9d09-4d86-aa5c-b459c03ac4a2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:56.650645 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d66c0873-9d09-4d86-aa5c-b459c03ac4a2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:56.657136 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d66c0873-9d09-4d86-aa5c-b459c03ac4a2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:56.657579 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d66c0873-9d09-4d86-aa5c-b459c03ac4a2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:56.658330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d66c0873-9d09-4d86-aa5c-b459c03ac4a2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:56.658791 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d66c0873-9d09-4d86-aa5c-b459c03ac4a2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:56.784621 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d66c0873-9d09-4d86-aa5c-b459c03ac4a2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:56.792221 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d66c0873-9d09-4d86-aa5c-b459c03ac4a2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.145938 Jun 15 15:50:56.793157 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 88/177] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:56 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:56.840066 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-86fe8cf1-0796-43a9-9467-07009552d85b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:56.840709 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-86fe8cf1-0796-43a9-9467-07009552d85b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:56.847190 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-86fe8cf1-0796-43a9-9467-07009552d85b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:56.847635 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-86fe8cf1-0796-43a9-9467-07009552d85b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:56.848387 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-86fe8cf1-0796-43a9-9467-07009552d85b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:56.848820 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-86fe8cf1-0796-43a9-9467-07009552d85b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:56.973531 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-86fe8cf1-0796-43a9-9467-07009552d85b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:56.981382 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-86fe8cf1-0796-43a9-9467-07009552d85b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:56.982899 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-86fe8cf1-0796-43a9-9467-07009552d85b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:56.983981 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-86fe8cf1-0796-43a9-9467-07009552d85b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.147753 Jun 15 15:50:56.984532 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 90/178] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:56 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:57.639412 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1df7a877-5150-40c6-ac38-3775dc3bd9e3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:57.640038 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1df7a877-5150-40c6-ac38-3775dc3bd9e3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:57.646610 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1df7a877-5150-40c6-ac38-3775dc3bd9e3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:57.647085 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1df7a877-5150-40c6-ac38-3775dc3bd9e3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:57.647827 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1df7a877-5150-40c6-ac38-3775dc3bd9e3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:57.648255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1df7a877-5150-40c6-ac38-3775dc3bd9e3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:57.777396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1df7a877-5150-40c6-ac38-3775dc3bd9e3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:57.784781 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1df7a877-5150-40c6-ac38-3775dc3bd9e3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.149223 Jun 15 15:50:57.785344 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 89/179] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:57 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:57.809099 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2be0b0d6-73e9-492a-a04f-2ab227452148 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:57.809704 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2be0b0d6-73e9-492a-a04f-2ab227452148 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:57.816338 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2be0b0d6-73e9-492a-a04f-2ab227452148 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:57.816773 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2be0b0d6-73e9-492a-a04f-2ab227452148 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:57.817519 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2be0b0d6-73e9-492a-a04f-2ab227452148 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:57.817948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2be0b0d6-73e9-492a-a04f-2ab227452148 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:57.944961 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2be0b0d6-73e9-492a-a04f-2ab227452148 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:57.952320 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2be0b0d6-73e9-492a-a04f-2ab227452148 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.146995 Jun 15 15:50:57.952885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 91/180] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:57 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:58.002339 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-367e966c-b667-400e-a498-9dbc75e61d59 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:58.002980 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-367e966c-b667-400e-a498-9dbc75e61d59 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:58.009003 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-367e966c-b667-400e-a498-9dbc75e61d59 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:58.009451 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-367e966c-b667-400e-a498-9dbc75e61d59 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:58.010539 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-367e966c-b667-400e-a498-9dbc75e61d59 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:58.011006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-367e966c-b667-400e-a498-9dbc75e61d59 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:58.141194 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-367e966c-b667-400e-a498-9dbc75e61d59 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:58.149193 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-367e966c-b667-400e-a498-9dbc75e61d59 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:58.150710 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-367e966c-b667-400e-a498-9dbc75e61d59 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:58.151821 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-367e966c-b667-400e-a498-9dbc75e61d59 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.154177 Jun 15 15:50:58.152381 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 90/181] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:57 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:58.801182 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f2529b8b-990e-4439-99fe-039c1a560c05 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:58.801783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f2529b8b-990e-4439-99fe-039c1a560c05 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:58.807820 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2529b8b-990e-4439-99fe-039c1a560c05 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:58.808261 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2529b8b-990e-4439-99fe-039c1a560c05 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:58.809006 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2529b8b-990e-4439-99fe-039c1a560c05 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:58.809432 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2529b8b-990e-4439-99fe-039c1a560c05 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:58.935009 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f2529b8b-990e-4439-99fe-039c1a560c05 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:58.943007 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f2529b8b-990e-4439-99fe-039c1a560c05 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.145596 Jun 15 15:50:58.943563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 92/182] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:58 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:58.968185 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-18e207cd-5407-4e60-aa9e-69a250157037 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:58.968795 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-18e207cd-5407-4e60-aa9e-69a250157037 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:58.974787 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-18e207cd-5407-4e60-aa9e-69a250157037 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:58.975239 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-18e207cd-5407-4e60-aa9e-69a250157037 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:58.976002 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-18e207cd-5407-4e60-aa9e-69a250157037 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:58.976438 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-18e207cd-5407-4e60-aa9e-69a250157037 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:59.098323 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-18e207cd-5407-4e60-aa9e-69a250157037 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:59.105633 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-18e207cd-5407-4e60-aa9e-69a250157037 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1362 microversion: 2.1 time: 0.141227 Jun 15 15:50:59.106204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 91/183] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:58 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:50:59.169493 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c841054a-8f76-43dc-a462-6f35f614251f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:59.170089 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c841054a-8f76-43dc-a462-6f35f614251f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:59.176203 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c841054a-8f76-43dc-a462-6f35f614251f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:59.176706 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c841054a-8f76-43dc-a462-6f35f614251f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:59.177451 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c841054a-8f76-43dc-a462-6f35f614251f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:59.177876 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c841054a-8f76-43dc-a462-6f35f614251f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:59.480957 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c841054a-8f76-43dc-a462-6f35f614251f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:59.489354 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c841054a-8f76-43dc-a462-6f35f614251f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:59.490894 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c841054a-8f76-43dc-a462-6f35f614251f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:50:59.491984 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c841054a-8f76-43dc-a462-6f35f614251f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.326487 Jun 15 15:50:59.492529 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 93/184] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:50:59 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:50:59.960164 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a4819e36-60a9-42d1-a5a3-6047ec0c761f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:50:59.960776 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a4819e36-60a9-42d1-a5a3-6047ec0c761f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:50:59.966923 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4819e36-60a9-42d1-a5a3-6047ec0c761f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:59.967370 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4819e36-60a9-42d1-a5a3-6047ec0c761f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:50:59.968127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4819e36-60a9-42d1-a5a3-6047ec0c761f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:50:59.969220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4819e36-60a9-42d1-a5a3-6047ec0c761f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:00.101496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a4819e36-60a9-42d1-a5a3-6047ec0c761f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:00.109751 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a4819e36-60a9-42d1-a5a3-6047ec0c761f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.153305 Jun 15 15:51:00.110324 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 92/185] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:50:59 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:00.122481 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-205d0c70-ae49-4cda-ab14-37b0e9b24fee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:00.123117 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-205d0c70-ae49-4cda-ab14-37b0e9b24fee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:00.129117 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-205d0c70-ae49-4cda-ab14-37b0e9b24fee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:00.129560 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-205d0c70-ae49-4cda-ab14-37b0e9b24fee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:00.130319 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-205d0c70-ae49-4cda-ab14-37b0e9b24fee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:00.130775 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-205d0c70-ae49-4cda-ab14-37b0e9b24fee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:00.261309 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-205d0c70-ae49-4cda-ab14-37b0e9b24fee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:00.269295 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-205d0c70-ae49-4cda-ab14-37b0e9b24fee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1549 microversion: 2.1 time: 0.150573 Jun 15 15:51:00.269851 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 94/186] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:00 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:00.288409 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b6b81bac-e39b-46f9-9890-c77ebc8daada tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:00.288898 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b6b81bac-e39b-46f9-9890-c77ebc8daada tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:00.294980 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b6b81bac-e39b-46f9-9890-c77ebc8daada tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:00.295424 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b6b81bac-e39b-46f9-9890-c77ebc8daada tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:00.296191 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b6b81bac-e39b-46f9-9890-c77ebc8daada tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:00.296654 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b6b81bac-e39b-46f9-9890-c77ebc8daada tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:00.414428 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b6b81bac-e39b-46f9-9890-c77ebc8daada tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130531 Jun 15 15:51:00.415081 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 93/187] 10.222.0.62 () {58 vars in 1274 bytes} [Wed Jun 15 15:51:00 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:51:00.509597 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1435f441-170a-47a7-8a55-ac78112e5cfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:00.510491 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1435f441-170a-47a7-8a55-ac78112e5cfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:00.517441 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1435f441-170a-47a7-8a55-ac78112e5cfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:00.518044 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1435f441-170a-47a7-8a55-ac78112e5cfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:00.519054 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1435f441-170a-47a7-8a55-ac78112e5cfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:00.519585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1435f441-170a-47a7-8a55-ac78112e5cfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:00.807361 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1435f441-170a-47a7-8a55-ac78112e5cfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:00.815778 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1435f441-170a-47a7-8a55-ac78112e5cfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:00.817261 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1435f441-170a-47a7-8a55-ac78112e5cfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:00.818339 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1435f441-170a-47a7-8a55-ac78112e5cfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.312850 Jun 15 15:51:00.818914 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 95/188] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:51:00 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:51:01.126333 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-23554dad-580f-4668-b82c-fe20da14f3f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:01.127018 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-23554dad-580f-4668-b82c-fe20da14f3f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:01.133092 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23554dad-580f-4668-b82c-fe20da14f3f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:01.133729 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23554dad-580f-4668-b82c-fe20da14f3f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:01.134490 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23554dad-580f-4668-b82c-fe20da14f3f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:01.134958 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23554dad-580f-4668-b82c-fe20da14f3f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:01.196873 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-93111fad-35c7-4843-9459-7519cbc81374 req-13ffa533-bb1c-4c25-b8dc-d897dcf7c01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa56f23-7713-4cc8-936c-b4f47a8506aa", "name": "network-vif-plugged", "status": "completed", "tag": "ce9ef32f-0f8b-4f92-af0e-f440f9f4f5a8"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:01.207303 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-93111fad-35c7-4843-9459-7519cbc81374 req-13ffa533-bb1c-4c25-b8dc-d897dcf7c01e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:01.208273 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-93111fad-35c7-4843-9459-7519cbc81374 req-13ffa533-bb1c-4c25-b8dc-d897dcf7c01e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:01.227215 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-93111fad-35c7-4843-9459-7519cbc81374 req-13ffa533-bb1c-4c25-b8dc-d897dcf7c01e service nova] Creating event network-vif-plugged:ce9ef32f-0f8b-4f92-af0e-f440f9f4f5a8 for instance caa56f23-7713-4cc8-936c-b4f47a8506aa on hv-cinder-84599 Jun 15 15:51:01.239378 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-93111fad-35c7-4843-9459-7519cbc81374 req-13ffa533-bb1c-4c25-b8dc-d897dcf7c01e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047379 Jun 15 15:51:01.240635 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 96/189] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:51:01.434049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-23554dad-580f-4668-b82c-fe20da14f3f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:01.442548 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-23554dad-580f-4668-b82c-fe20da14f3f1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.320022 Jun 15 15:51:01.443226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 94/190] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:01 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:01.837219 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0db1530d-1155-413d-bcc0-a2b5dc88517a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:01.837929 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0db1530d-1155-413d-bcc0-a2b5dc88517a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:01.844934 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0db1530d-1155-413d-bcc0-a2b5dc88517a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:01.845381 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0db1530d-1155-413d-bcc0-a2b5dc88517a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:01.846158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0db1530d-1155-413d-bcc0-a2b5dc88517a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:01.846591 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0db1530d-1155-413d-bcc0-a2b5dc88517a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:02.091871 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0db1530d-1155-413d-bcc0-a2b5dc88517a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:02.116159 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0db1530d-1155-413d-bcc0-a2b5dc88517a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:02.119907 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0db1530d-1155-413d-bcc0-a2b5dc88517a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:02.120274 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-01e64a7f-fad8-4862-8c41-0ecf0324d000 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "583217ea-438b-44e0-8a45-c13e7f2dec73"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:02.121426 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-01e64a7f-fad8-4862-8c41-0ecf0324d000 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:02.125971 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0db1530d-1155-413d-bcc0-a2b5dc88517a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.292941 Jun 15 15:51:02.126547 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 97/191] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:51:01 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:51:02.151607 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-01e64a7f-fad8-4862-8c41-0ecf0324d000 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:02.152183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-01e64a7f-fad8-4862-8c41-0ecf0324d000 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:02.156154 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-01e64a7f-fad8-4862-8c41-0ecf0324d000 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:02.158001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-01e64a7f-fad8-4862-8c41-0ecf0324d000 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:02.326059 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-332ece57-9c22-4c6b-9f3b-b9e30286bf9f req-3e2a2be3-c74e-4f40-99e7-9d7ac0143341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e67259e-9dd3-4875-9185-fa11291a54d9", "tag": "a85add08-672c-4dce-8f28-ed6c32fa8484"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:02.336935 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-332ece57-9c22-4c6b-9f3b-b9e30286bf9f req-3e2a2be3-c74e-4f40-99e7-9d7ac0143341 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:02.338037 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-332ece57-9c22-4c6b-9f3b-b9e30286bf9f req-3e2a2be3-c74e-4f40-99e7-9d7ac0143341 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:02.350859 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-332ece57-9c22-4c6b-9f3b-b9e30286bf9f req-3e2a2be3-c74e-4f40-99e7-9d7ac0143341 service nova] Creating event network-changed:a85add08-672c-4dce-8f28-ed6c32fa8484 for instance 9e67259e-9dd3-4875-9185-fa11291a54d9 on hv-cinder-84599 Jun 15 15:51:02.356284 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-332ece57-9c22-4c6b-9f3b-b9e30286bf9f req-3e2a2be3-c74e-4f40-99e7-9d7ac0143341 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034042 Jun 15 15:51:02.357193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 98/192] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:51:02.462354 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a70fb8e0-5859-4aa2-b9df-0de2f8facadb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:02.463298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a70fb8e0-5859-4aa2-b9df-0de2f8facadb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:02.471045 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a70fb8e0-5859-4aa2-b9df-0de2f8facadb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:02.471494 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a70fb8e0-5859-4aa2-b9df-0de2f8facadb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:02.472252 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a70fb8e0-5859-4aa2-b9df-0de2f8facadb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:02.472856 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a70fb8e0-5859-4aa2-b9df-0de2f8facadb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:02.702294 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a70fb8e0-5859-4aa2-b9df-0de2f8facadb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:02.718707 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a70fb8e0-5859-4aa2-b9df-0de2f8facadb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.262260 Jun 15 15:51:02.720720 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 99/193] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:02 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:03.145536 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6552a559-2ee8-4c3d-ab59-71382722b70b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:03.146158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6552a559-2ee8-4c3d-ab59-71382722b70b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:03.155929 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6552a559-2ee8-4c3d-ab59-71382722b70b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:03.156398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6552a559-2ee8-4c3d-ab59-71382722b70b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:03.157462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6552a559-2ee8-4c3d-ab59-71382722b70b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:03.157905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6552a559-2ee8-4c3d-ab59-71382722b70b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:03.374769 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6552a559-2ee8-4c3d-ab59-71382722b70b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:03.384927 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6552a559-2ee8-4c3d-ab59-71382722b70b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:03.389429 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6552a559-2ee8-4c3d-ab59-71382722b70b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:03.390771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6552a559-2ee8-4c3d-ab59-71382722b70b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1407 microversion: 2.20 time: 0.250552 Jun 15 15:51:03.401001 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 100/194] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:51:03 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:51:03.735827 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5054bf4d-ff31-4836-9a0a-305c651ff45f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:03.736171 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5054bf4d-ff31-4836-9a0a-305c651ff45f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:03.745337 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5054bf4d-ff31-4836-9a0a-305c651ff45f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:03.745993 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5054bf4d-ff31-4836-9a0a-305c651ff45f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:03.747127 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5054bf4d-ff31-4836-9a0a-305c651ff45f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:03.747733 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5054bf4d-ff31-4836-9a0a-305c651ff45f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:03.753742 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:03.917339 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5054bf4d-ff31-4836-9a0a-305c651ff45f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:03.925490 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5054bf4d-ff31-4836-9a0a-305c651ff45f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1366 microversion: 2.1 time: 0.193561 Jun 15 15:51:03.926586 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 101/195] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:03 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:04.413031 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-444a1701-fc02-483c-ad3c-a8a069f8dd47 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:04.413643 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-444a1701-fc02-483c-ad3c-a8a069f8dd47 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:04.422244 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-444a1701-fc02-483c-ad3c-a8a069f8dd47 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:04.422692 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-444a1701-fc02-483c-ad3c-a8a069f8dd47 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:04.423950 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-444a1701-fc02-483c-ad3c-a8a069f8dd47 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:04.424890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-444a1701-fc02-483c-ad3c-a8a069f8dd47 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:04.695525 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-444a1701-fc02-483c-ad3c-a8a069f8dd47 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:04.707020 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-444a1701-fc02-483c-ad3c-a8a069f8dd47 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:04.708527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-444a1701-fc02-483c-ad3c-a8a069f8dd47 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:04.709683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-444a1701-fc02-483c-ad3c-a8a069f8dd47 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1598 microversion: 2.20 time: 0.300815 Jun 15 15:51:04.710555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 102/196] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:51:04 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1598 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:51:04.732715 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-939ae514-a903-4d8a-9fa5-033d377fba40 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:04.735404 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-939ae514-a903-4d8a-9fa5-033d377fba40 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:04.747662 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-939ae514-a903-4d8a-9fa5-033d377fba40 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:04.757410 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-939ae514-a903-4d8a-9fa5-033d377fba40 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:04.758328 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-939ae514-a903-4d8a-9fa5-033d377fba40 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:04.760605 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-939ae514-a903-4d8a-9fa5-033d377fba40 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:04.984084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-939ae514-a903-4d8a-9fa5-033d377fba40 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.258185 Jun 15 15:51:04.985519 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 103/197] 10.222.0.62 () {60 vars in 1315 bytes} [Wed Jun 15 15:51:04 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-interface => generated 284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:51:04.993823 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7e1e7f4a-1998-46f8-846d-b7432729e952 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:04.994960 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7e1e7f4a-1998-46f8-846d-b7432729e952 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:05.009353 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7e1e7f4a-1998-46f8-846d-b7432729e952 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:05.011618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7e1e7f4a-1998-46f8-846d-b7432729e952 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:05.013441 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7e1e7f4a-1998-46f8-846d-b7432729e952 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:05.016026 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7e1e7f4a-1998-46f8-846d-b7432729e952 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:05.091229 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-01e64a7f-fad8-4862-8c41-0ecf0324d000 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "POST /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.974935 Jun 15 15:51:05.093049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 95/198] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 15:51:02 2022] POST /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca/os-volume_attachments => generated 194 bytes in 2978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:51:05.377416 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7e1e7f4a-1998-46f8-846d-b7432729e952 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:05.387732 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7e1e7f4a-1998-46f8-846d-b7432729e952 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1555 microversion: 2.1 time: 0.398446 Jun 15 15:51:05.403463 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 104/199] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:04 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1555 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:05.408987 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2004ba2f-89fd-42df-bc52-dbada23121ad tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:05.409564 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2004ba2f-89fd-42df-bc52-dbada23121ad tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:05.416877 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2004ba2f-89fd-42df-bc52-dbada23121ad tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:05.417827 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2004ba2f-89fd-42df-bc52-dbada23121ad tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:05.418832 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2004ba2f-89fd-42df-bc52-dbada23121ad tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:05.419487 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2004ba2f-89fd-42df-bc52-dbada23121ad tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:05.579934 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2004ba2f-89fd-42df-bc52-dbada23121ad tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175107 Jun 15 15:51:05.582203 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 96/200] 10.222.0.62 () {58 vars in 1274 bytes} [Wed Jun 15 15:51:05 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:51:06.634762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-b4918af1-640e-4b77-8d43-af632f9e3ccd req-2504280d-078f-4ab1-8818-5aa2788a32f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ff33fe-05bf-4bd5-9159-69805bae0aed", "tag": "229f5bd2-2de2-41f9-ac9f-ef6b3af254d6"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:06.644771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-b4918af1-640e-4b77-8d43-af632f9e3ccd req-2504280d-078f-4ab1-8818-5aa2788a32f3 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:06.645430 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-b4918af1-640e-4b77-8d43-af632f9e3ccd req-2504280d-078f-4ab1-8818-5aa2788a32f3 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:06.663388 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-b4918af1-640e-4b77-8d43-af632f9e3ccd req-2504280d-078f-4ab1-8818-5aa2788a32f3 service nova] Creating event network-changed:229f5bd2-2de2-41f9-ac9f-ef6b3af254d6 for instance c8ff33fe-05bf-4bd5-9159-69805bae0aed on hv-cinder-84599 Jun 15 15:51:06.669562 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-b4918af1-640e-4b77-8d43-af632f9e3ccd req-2504280d-078f-4ab1-8818-5aa2788a32f3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039232 Jun 15 15:51:06.670781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 105/201] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:51:08.308885 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-fbad2039-2d7a-4d1f-a500-0078d5746e3d req-8a768240-207c-46a1-9679-6822a70f7224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa56f23-7713-4cc8-936c-b4f47a8506aa", "tag": "ce9ef32f-0f8b-4f92-af0e-f440f9f4f5a8"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:08.318593 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-fbad2039-2d7a-4d1f-a500-0078d5746e3d req-8a768240-207c-46a1-9679-6822a70f7224 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:08.319498 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-fbad2039-2d7a-4d1f-a500-0078d5746e3d req-8a768240-207c-46a1-9679-6822a70f7224 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:08.333576 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-fbad2039-2d7a-4d1f-a500-0078d5746e3d req-8a768240-207c-46a1-9679-6822a70f7224 service nova] Creating event network-changed:ce9ef32f-0f8b-4f92-af0e-f440f9f4f5a8 for instance caa56f23-7713-4cc8-936c-b4f47a8506aa on hv-cinder-84599 Jun 15 15:51:08.340252 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-fbad2039-2d7a-4d1f-a500-0078d5746e3d req-8a768240-207c-46a1-9679-6822a70f7224 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036836 Jun 15 15:51:08.345995 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 97/202] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:51:16.005464 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8b3dcf1b-b3ff-47cf-ba50-4603750ba196 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:16.006815 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8b3dcf1b-b3ff-47cf-ba50-4603750ba196 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:16.014320 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8b3dcf1b-b3ff-47cf-ba50-4603750ba196 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:16.015135 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8b3dcf1b-b3ff-47cf-ba50-4603750ba196 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:16.016339 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8b3dcf1b-b3ff-47cf-ba50-4603750ba196 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:16.016771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8b3dcf1b-b3ff-47cf-ba50-4603750ba196 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:16.048012 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8b3dcf1b-b3ff-47cf-ba50-4603750ba196 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Going to try to terminate instance {{(pid=123934) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:51:16.140334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8b3dcf1b-b3ff-47cf-ba50-4603750ba196 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "DELETE /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 204 len: 0 microversion: 2.1 time: 0.140434 Jun 15 15:51:16.141004 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 106/203] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:51:15 2022] DELETE /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:51:16.150637 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-31a31009-ba6c-4ca6-86b7-7ca8196b1ae3 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:16.152145 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-31a31009-ba6c-4ca6-86b7-7ca8196b1ae3 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:16.160301 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-31a31009-ba6c-4ca6-86b7-7ca8196b1ae3 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:16.160751 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-31a31009-ba6c-4ca6-86b7-7ca8196b1ae3 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:16.162163 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-31a31009-ba6c-4ca6-86b7-7ca8196b1ae3 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:16.162577 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-31a31009-ba6c-4ca6-86b7-7ca8196b1ae3 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:16.303447 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-31a31009-ba6c-4ca6-86b7-7ca8196b1ae3 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:16.311445 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-31a31009-ba6c-4ca6-86b7-7ca8196b1ae3 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1552 microversion: 2.1 time: 0.166124 Jun 15 15:51:16.312215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 98/204] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:16 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:17.329895 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-842f52a1-454e-4cb0-8ac1-19158f1fd194 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:17.330598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-842f52a1-454e-4cb0-8ac1-19158f1fd194 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:17.338214 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-842f52a1-454e-4cb0-8ac1-19158f1fd194 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:17.338659 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-842f52a1-454e-4cb0-8ac1-19158f1fd194 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:17.340276 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-842f52a1-454e-4cb0-8ac1-19158f1fd194 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:17.340723 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-842f52a1-454e-4cb0-8ac1-19158f1fd194 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:17.488121 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-842f52a1-454e-4cb0-8ac1-19158f1fd194 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:17.497171 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-842f52a1-454e-4cb0-8ac1-19158f1fd194 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1552 microversion: 2.1 time: 0.172460 Jun 15 15:51:17.498027 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 107/205] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:17 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:18.514008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a75b0b9e-c3cf-4f95-9798-8940aba7ad45 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:18.515380 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a75b0b9e-c3cf-4f95-9798-8940aba7ad45 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:18.522877 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a75b0b9e-c3cf-4f95-9798-8940aba7ad45 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:18.523485 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a75b0b9e-c3cf-4f95-9798-8940aba7ad45 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:18.524535 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a75b0b9e-c3cf-4f95-9798-8940aba7ad45 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:18.525318 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a75b0b9e-c3cf-4f95-9798-8940aba7ad45 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:18.668760 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a75b0b9e-c3cf-4f95-9798-8940aba7ad45 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:18.676983 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a75b0b9e-c3cf-4f95-9798-8940aba7ad45 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1552 microversion: 2.1 time: 0.166716 Jun 15 15:51:18.677751 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 99/206] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:18 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:19.695206 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-47da42fb-4316-483e-bc4d-739a435ea89c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:19.695845 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-47da42fb-4316-483e-bc4d-739a435ea89c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:19.702085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47da42fb-4316-483e-bc4d-739a435ea89c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:19.702574 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47da42fb-4316-483e-bc4d-739a435ea89c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:19.703402 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47da42fb-4316-483e-bc4d-739a435ea89c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:19.703840 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47da42fb-4316-483e-bc4d-739a435ea89c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:19.841839 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-47da42fb-4316-483e-bc4d-739a435ea89c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:19.852054 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-47da42fb-4316-483e-bc4d-739a435ea89c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1552 microversion: 2.1 time: 0.160300 Jun 15 15:51:19.852406 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 108/207] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:19 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:20.869600 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-459b8b1d-cd1f-4384-af8d-0952815cc46b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:20.870781 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-459b8b1d-cd1f-4384-af8d-0952815cc46b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:20.877377 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-459b8b1d-cd1f-4384-af8d-0952815cc46b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:20.877822 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-459b8b1d-cd1f-4384-af8d-0952815cc46b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:20.878583 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-459b8b1d-cd1f-4384-af8d-0952815cc46b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:20.879037 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-459b8b1d-cd1f-4384-af8d-0952815cc46b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:21.012186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-459b8b1d-cd1f-4384-af8d-0952815cc46b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:21.021016 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-459b8b1d-cd1f-4384-af8d-0952815cc46b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1552 microversion: 2.1 time: 0.155558 Jun 15 15:51:21.021762 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 100/208] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:20 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:22.038856 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8ed23858-cf1a-41ec-ad20-439ba48f8e48 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:22.039443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8ed23858-cf1a-41ec-ad20-439ba48f8e48 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:22.041420 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:22.047342 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8ed23858-cf1a-41ec-ad20-439ba48f8e48 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:22.047785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8ed23858-cf1a-41ec-ad20-439ba48f8e48 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:22.048533 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8ed23858-cf1a-41ec-ad20-439ba48f8e48 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:22.048959 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8ed23858-cf1a-41ec-ad20-439ba48f8e48 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:22.186331 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8ed23858-cf1a-41ec-ad20-439ba48f8e48 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:22.199046 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8ed23858-cf1a-41ec-ad20-439ba48f8e48 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1552 microversion: 2.1 time: 0.164098 Jun 15 15:51:22.199541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 109/209] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:22 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:23.216846 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b9fd9235-9dc7-418c-bf35-e798d4f7f251 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:23.217455 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b9fd9235-9dc7-418c-bf35-e798d4f7f251 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:23.225768 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=40 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:23.228138 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b9fd9235-9dc7-418c-bf35-e798d4f7f251 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:23.228925 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b9fd9235-9dc7-418c-bf35-e798d4f7f251 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:23.230364 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b9fd9235-9dc7-418c-bf35-e798d4f7f251 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:23.230818 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b9fd9235-9dc7-418c-bf35-e798d4f7f251 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:23.236593 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:23.512622 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b9fd9235-9dc7-418c-bf35-e798d4f7f251 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:23.531997 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b9fd9235-9dc7-418c-bf35-e798d4f7f251 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1552 microversion: 2.1 time: 0.319596 Jun 15 15:51:23.533955 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 101/210] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:23 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1552 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:23.884182 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-8a432431-bc95-4b51-94a9-a0317157d67c req-20e6a850-0703-4667-87e7-c20ce42dbe21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876e0580-8662-495b-8d2b-99ca8643a1ca", "name": "network-vif-deleted", "tag": "06cd31d6-3f6b-426a-bec7-4508a878ff64"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:23.899074 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-8a432431-bc95-4b51-94a9-a0317157d67c req-20e6a850-0703-4667-87e7-c20ce42dbe21 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:23.899815 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-8a432431-bc95-4b51-94a9-a0317157d67c req-20e6a850-0703-4667-87e7-c20ce42dbe21 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:23.913829 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-8a432431-bc95-4b51-94a9-a0317157d67c req-20e6a850-0703-4667-87e7-c20ce42dbe21 service nova] Creating event network-vif-deleted:06cd31d6-3f6b-426a-bec7-4508a878ff64 for instance 876e0580-8662-495b-8d2b-99ca8643a1ca on hv-cinder-84599 Jun 15 15:51:23.920965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-8a432431-bc95-4b51-94a9-a0317157d67c req-20e6a850-0703-4667-87e7-c20ce42dbe21 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042249 Jun 15 15:51:23.922057 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 110/211] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:51:24.552967 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c1326a84-7544-4108-a4a1-e54c9ecf017d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:24.553700 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c1326a84-7544-4108-a4a1-e54c9ecf017d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:24.560536 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c1326a84-7544-4108-a4a1-e54c9ecf017d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:24.561064 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c1326a84-7544-4108-a4a1-e54c9ecf017d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:24.562454 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c1326a84-7544-4108-a4a1-e54c9ecf017d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:24.562878 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c1326a84-7544-4108-a4a1-e54c9ecf017d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:24.629223 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c1326a84-7544-4108-a4a1-e54c9ecf017d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:24.640424 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c1326a84-7544-4108-a4a1-e54c9ecf017d tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1345 microversion: 2.1 time: 0.093383 Jun 15 15:51:24.640994 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 102/212] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:24 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:25.658828 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3bb6fe37-b175-4eb4-a788-33e00581f09b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:25.659556 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3bb6fe37-b175-4eb4-a788-33e00581f09b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:25.666245 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3bb6fe37-b175-4eb4-a788-33e00581f09b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:25.666773 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3bb6fe37-b175-4eb4-a788-33e00581f09b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:25.667622 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3bb6fe37-b175-4eb4-a788-33e00581f09b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:25.668206 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3bb6fe37-b175-4eb4-a788-33e00581f09b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:25.709362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3bb6fe37-b175-4eb4-a788-33e00581f09b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:25.709989 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3bb6fe37-b175-4eb4-a788-33e00581f09b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:25.710475 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-3bb6fe37-b175-4eb4-a788-33e00581f09b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lazy-loading 'fault' on Instance uuid 876e0580-8662-495b-8d2b-99ca8643a1ca {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:51:25.757412 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3bb6fe37-b175-4eb4-a788-33e00581f09b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1d2305db6284067bfb37c3b1bf198fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8fb15aaa4ac4d55a68b821f99bbffd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:25.767773 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3bb6fe37-b175-4eb4-a788-33e00581f09b tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 200 len: 1350 microversion: 2.1 time: 0.114281 Jun 15 15:51:25.768544 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 111/213] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:25 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 1350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:26.785164 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-bca9a4be-1a39-42da-8bf8-07f5bc7e1e2c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:26.785856 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-bca9a4be-1a39-42da-8bf8-07f5bc7e1e2c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:26.794281 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bca9a4be-1a39-42da-8bf8-07f5bc7e1e2c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:26.796726 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bca9a4be-1a39-42da-8bf8-07f5bc7e1e2c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:26.797602 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bca9a4be-1a39-42da-8bf8-07f5bc7e1e2c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:26.798118 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bca9a4be-1a39-42da-8bf8-07f5bc7e1e2c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:26.813350 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-bca9a4be-1a39-42da-8bf8-07f5bc7e1e2c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] HTTP exception thrown: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-bca9a4be-1a39-42da-8bf8-07f5bc7e1e2c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Request method failure captured: Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca HTTP/1.1 Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-hn-Miqtsp2IHUePq0PCqrwzqmaaZe3n-8eYKTv3_QUe8D3wkvuTz7I3GGDehaapJfSbR9RZI33ViDIvVwCTswtd76SYNhdTPg8Ms5Kl8xFqa3884IE_n_rcEeJMda_6ZVDuHQLObB9M86m4dX7_XmxuPMAHlfdEqowajVKzFzYVg Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: a8fb15aaa4ac4d55a68b821f99bbffd7 Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:51:26.818067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a8fb15aaa4ac4d55a68b821f99bbffd7", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: a8fb15aaa4ac4d55a68b821f99bbffd7 Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-DeleteServersTestJSON-1280450896-project Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: c1d2305db6284067bfb37c3b1bf198fa Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-DeleteServersTestJSON-1280450896-project Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:26.819402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': '876e0580-8662-495b-8d2b-99ca8643a1ca'} Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:51:26.820077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:26.821225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:51:26.822212 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-bca9a4be-1a39-42da-8bf8-07f5bc7e1e2c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Returning 404 to user: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:51:26.822212 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-bca9a4be-1a39-42da-8bf8-07f5bc7e1e2c tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 404 len: 111 microversion: 2.1 time: 0.038377 Jun 15 15:51:26.822212 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 103/214] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:26 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:51:26.959427 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6928589f-171b-4c86-b1c7-367b8c0d5d90 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:26.960341 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6928589f-171b-4c86-b1c7-367b8c0d5d90 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:26.966640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6928589f-171b-4c86-b1c7-367b8c0d5d90 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:26.967139 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6928589f-171b-4c86-b1c7-367b8c0d5d90 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:26.968439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6928589f-171b-4c86-b1c7-367b8c0d5d90 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:26.968859 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6928589f-171b-4c86-b1c7-367b8c0d5d90 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:26.981586 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-6928589f-171b-4c86-b1c7-367b8c0d5d90 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] HTTP exception thrown: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6928589f-171b-4c86-b1c7-367b8c0d5d90 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Request method failure captured: Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca/os-volume_attachments HTTP/1.1 Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-hn-Miqtsp2IHUePq0PCqrwzqmaaZe3n-8eYKTv3_QUe8D3wkvuTz7I3GGDehaapJfSbR9RZI33ViDIvVwCTswtd76SYNhdTPg8Ms5Kl8xFqa3884IE_n_rcEeJMda_6ZVDuHQLObB9M86m4dX7_XmxuPMAHlfdEqowajVKzFzYVg Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: a8fb15aaa4ac4d55a68b821f99bbffd7 Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:51:26.986571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a8fb15aaa4ac4d55a68b821f99bbffd7", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: a8fb15aaa4ac4d55a68b821f99bbffd7 Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-DeleteServersTestJSON-1280450896-project Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: c1d2305db6284067bfb37c3b1bf198fa Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-DeleteServersTestJSON-1280450896-project Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:26.987949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'server_id': '876e0580-8662-495b-8d2b-99ca8643a1ca'} Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:51:26.988609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:26.989680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:51:26.990958 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6928589f-171b-4c86-b1c7-367b8c0d5d90 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Returning 404 to user: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:51:26.990958 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6928589f-171b-4c86-b1c7-367b8c0d5d90 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032414 Jun 15 15:51:26.990958 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 112/215] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:51:26 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:51:28.198497 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ceae5199-cfe2-4ea5-b61a-dd7c75a22f56 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:28.199054 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ceae5199-cfe2-4ea5-b61a-dd7c75a22f56 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:28.205737 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ceae5199-cfe2-4ea5-b61a-dd7c75a22f56 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:28.206184 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ceae5199-cfe2-4ea5-b61a-dd7c75a22f56 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:28.206977 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ceae5199-cfe2-4ea5-b61a-dd7c75a22f56 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:28.207413 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ceae5199-cfe2-4ea5-b61a-dd7c75a22f56 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:28.221373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-ceae5199-cfe2-4ea5-b61a-dd7c75a22f56 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] HTTP exception thrown: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ceae5199-cfe2-4ea5-b61a-dd7c75a22f56 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Request method failure captured: Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: DELETE /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca HTTP/1.1 Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-hn-Miqtsp2IHUePq0PCqrwzqmaaZe3n-8eYKTv3_QUe8D3wkvuTz7I3GGDehaapJfSbR9RZI33ViDIvVwCTswtd76SYNhdTPg8Ms5Kl8xFqa3884IE_n_rcEeJMda_6ZVDuHQLObB9M86m4dX7_XmxuPMAHlfdEqowajVKzFzYVg Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: a8fb15aaa4ac4d55a68b821f99bbffd7 Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:51:28.222926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a8fb15aaa4ac4d55a68b821f99bbffd7", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: a8fb15aaa4ac4d55a68b821f99bbffd7 Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-DeleteServersTestJSON-1280450896-project Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: c1d2305db6284067bfb37c3b1bf198fa Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-DeleteServersTestJSON-1280450896-project Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:28.224396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': '876e0580-8662-495b-8d2b-99ca8643a1ca'} Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:51:28.225107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:28.226331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:51:28.227636 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ceae5199-cfe2-4ea5-b61a-dd7c75a22f56 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Returning 404 to user: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:51:28.227636 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ceae5199-cfe2-4ea5-b61a-dd7c75a22f56 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "DELETE /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 404 len: 111 microversion: 2.1 time: 0.029703 Jun 15 15:51:28.227636 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 104/216] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:51:28 2022] DELETE /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:51:28.233203 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ab28fa43-08d3-4396-b15e-33413e795772 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:28.234676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ab28fa43-08d3-4396-b15e-33413e795772 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] [instance: 876e0580-8662-495b-8d2b-99ca8643a1ca] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:28.240643 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab28fa43-08d3-4396-b15e-33413e795772 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:28.241081 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab28fa43-08d3-4396-b15e-33413e795772 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:28.241821 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab28fa43-08d3-4396-b15e-33413e795772 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:28.242240 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab28fa43-08d3-4396-b15e-33413e795772 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:28.255968 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-ab28fa43-08d3-4396-b15e-33413e795772 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] HTTP exception thrown: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ab28fa43-08d3-4396-b15e-33413e795772 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Request method failure captured: Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca HTTP/1.1 Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-hn-Miqtsp2IHUePq0PCqrwzqmaaZe3n-8eYKTv3_QUe8D3wkvuTz7I3GGDehaapJfSbR9RZI33ViDIvVwCTswtd76SYNhdTPg8Ms5Kl8xFqa3884IE_n_rcEeJMda_6ZVDuHQLObB9M86m4dX7_XmxuPMAHlfdEqowajVKzFzYVg Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: a8fb15aaa4ac4d55a68b821f99bbffd7 Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:51:28.258106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a8fb15aaa4ac4d55a68b821f99bbffd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a8fb15aaa4ac4d55a68b821f99bbffd7", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: a8fb15aaa4ac4d55a68b821f99bbffd7 Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-DeleteServersTestJSON-1280450896 Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-DeleteServersTestJSON-1280450896-project Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: c1d2305db6284067bfb37c3b1bf198fa Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-DeleteServersTestJSON-1280450896-project Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:28.259604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '876e0580-8662-495b-8d2b-99ca8643a1ca'} Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:51:28.260834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. Jun 15 15:51:28.263184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:51:28.264425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ab28fa43-08d3-4396-b15e-33413e795772 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] Returning 404 to user: Instance 876e0580-8662-495b-8d2b-99ca8643a1ca could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:51:28.264425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ab28fa43-08d3-4396-b15e-33413e795772 tempest-DeleteServersTestJSON-1280450896 tempest-DeleteServersTestJSON-1280450896-project] 10.222.0.62 "GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca" status: 404 len: 111 microversion: 2.1 time: 0.030431 Jun 15 15:51:28.264425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 113/217] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:28 2022] GET /compute/v2.1/servers/876e0580-8662-495b-8d2b-99ca8643a1ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:51:35.746398 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1342766663", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:35.855972 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] validate_networks() for None {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:51:36.535469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:51:36.536123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:51:36.536620 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:51:36.537248 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:51:36.537651 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:51:36.551227 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:36.552336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:36.553392 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:36.554014 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:36.578337 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Getting quotas for project 718238a5852e4d9a93d85fa8fcf41643. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:51:36.583846 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Getting quotas for user 5d74c0a687664ac78d3c413251033e49 and project 718238a5852e4d9a93d85fa8fcf41643. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:51:36.598951 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:51:36.603080 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:51:36.661512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7dc55f9f-5596-4389-9153-1bbb7a43e2cb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919484 Jun 15 15:51:36.663100 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 105/218] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:51:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:51:36.673923 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-74588561-c930-4090-9365-599f7697aabb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:36.675165 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-74588561-c930-4090-9365-599f7697aabb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:36.759263 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-74588561-c930-4090-9365-599f7697aabb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:36.770792 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-74588561-c930-4090-9365-599f7697aabb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1215 microversion: 2.1 time: 0.098202 Jun 15 15:51:36.771904 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 114/219] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:36 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:37.369780 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1788675495", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:37.423047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] validate_networks() for [('2bc02b29-820d-4edc-a805-2d2f552df736', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:51:37.788768 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-08fd7baa-79ff-4602-92cf-d64e3e62f020 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:37.789372 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-08fd7baa-79ff-4602-92cf-d64e3e62f020 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:37.802332 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-08fd7baa-79ff-4602-92cf-d64e3e62f020 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:37.802791 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-08fd7baa-79ff-4602-92cf-d64e3e62f020 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:37.806720 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-08fd7baa-79ff-4602-92cf-d64e3e62f020 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:37.807379 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-08fd7baa-79ff-4602-92cf-d64e3e62f020 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:37.814045 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:37.833707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:51:37.834330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:51:37.839313 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:51:37.859879 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:51:37.862202 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:51:37.873619 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:37.874418 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:37.875520 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:37.876163 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:37.909980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-08fd7baa-79ff-4602-92cf-d64e3e62f020 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:37.924175 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-08fd7baa-79ff-4602-92cf-d64e3e62f020 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1267 microversion: 2.1 time: 0.139334 Jun 15 15:51:37.924950 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 115/220] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:37 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:37.936849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Getting quotas for project f2ed62f01ef846569c069e52fcfee36a. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:51:37.942379 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Getting quotas for user f8fcb09990db433e8ac0af3de37bdbc7 and project f2ed62f01ef846569c069e52fcfee36a. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:51:37.959052 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:51:37.962268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:51:38.019220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-35f3305b-6672-413f-ae8a-2ee7e8770a3c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.770216 Jun 15 15:51:38.025647 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 106/221] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:51:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:51:38.031646 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0127bf02-655d-4d58-b58a-b85bb86a62f2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:38.032286 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0127bf02-655d-4d58-b58a-b85bb86a62f2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:38.218522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0127bf02-655d-4d58-b58a-b85bb86a62f2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:38.227852 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0127bf02-655d-4d58-b58a-b85bb86a62f2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1222 microversion: 2.1 time: 0.200946 Jun 15 15:51:38.229594 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 116/222] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:38 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1222 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:38.308813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1637505765", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:38.424113 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] validate_networks() for [('2bc02b29-820d-4edc-a805-2d2f552df736', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:51:38.872747 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-862642195", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "networks": [{"uuid": "18f9d829-801b-468b-b861-5aa1d47f331c"}]}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:38.971365 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.network.neutron [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] validate_networks() for [('18f9d829-801b-468b-b861-5aa1d47f331c', None, None, None, None, None)] {{(pid=123934) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:51:39.754883 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:51:39.755393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:51:39.755884 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:51:39.756339 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:51:39.757202 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:51:39.778785 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:39.781334 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:39.784579 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:39.785561 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:39.859874 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Getting quotas for project f2ed62f01ef846569c069e52fcfee36a. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:51:39.884650 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Getting quotas for user f8fcb09990db433e8ac0af3de37bdbc7 and project f2ed62f01ef846569c069e52fcfee36a. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:51:39.938168 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:51:39.942926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:51:40.038159 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-96618f7e-f83a-4490-b3dc-625803bf95df tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.735829 Jun 15 15:51:40.051572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 107/223] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:51:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:51:40.073870 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f85f2b66-7bc4-44fe-92d5-8c7aee93479a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:40.074427 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f85f2b66-7bc4-44fe-92d5-8c7aee93479a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:40.096379 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f85f2b66-7bc4-44fe-92d5-8c7aee93479a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:40.097005 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f85f2b66-7bc4-44fe-92d5-8c7aee93479a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:40.097842 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f85f2b66-7bc4-44fe-92d5-8c7aee93479a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:40.098282 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f85f2b66-7bc4-44fe-92d5-8c7aee93479a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:40.173476 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Flavor limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:51:40.174154 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Image limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:51:40.174795 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Flavor pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:51:40.175827 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Image pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:51:40.176234 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:51:40.204006 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:40.204461 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:40.210017 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:40.213127 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:40.246618 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f85f2b66-7bc4-44fe-92d5-8c7aee93479a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:40.256789 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f85f2b66-7bc4-44fe-92d5-8c7aee93479a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1273 microversion: 2.1 time: 0.203838 Jun 15 15:51:40.257369 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 108/224] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:40 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:40.267340 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2f783d13-0918-414a-8708-5e59a712cd4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:40.269302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2f783d13-0918-414a-8708-5e59a712cd4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:40.338252 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Getting quotas for project bf53255e905344409fd64e4fba710dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:51:40.352084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Getting quotas for user e872bc2e7b214f0889ba95cc9352c59b and project bf53255e905344409fd64e4fba710dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:51:40.390112 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2f783d13-0918-414a-8708-5e59a712cd4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:40.408593 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Going to run 1 instances... {{(pid=123934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:51:40.413783 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2f783d13-0918-414a-8708-5e59a712cd4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1222 microversion: 2.1 time: 0.155023 Jun 15 15:51:40.415067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:51:40.424123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 109/225] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:40 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:40.488112 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-84609d53-67cd-4caf-869e-c48ab3398d0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.623396 Jun 15 15:51:40.489187 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 117/226] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:51:40.499642 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0566fb57-e64f-4f3b-9781-6a2358440c3a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:40.500330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0566fb57-e64f-4f3b-9781-6a2358440c3a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:40.716705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0566fb57-e64f-4f3b-9781-6a2358440c3a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:40.728861 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0566fb57-e64f-4f3b-9781-6a2358440c3a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1218 microversion: 2.1 time: 0.232704 Jun 15 15:51:40.729594 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 110/227] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:40 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1218 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:41.274197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-aa7bc792-cc41-4ebf-b073-5e923b6976e3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:41.274937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-aa7bc792-cc41-4ebf-b073-5e923b6976e3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:41.297899 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa7bc792-cc41-4ebf-b073-5e923b6976e3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:41.306489 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa7bc792-cc41-4ebf-b073-5e923b6976e3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:41.309040 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa7bc792-cc41-4ebf-b073-5e923b6976e3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:41.312900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa7bc792-cc41-4ebf-b073-5e923b6976e3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:41.454087 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-804c886b-3f1c-4c94-a7a2-eb5d70a3872d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:41.454719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-804c886b-3f1c-4c94-a7a2-eb5d70a3872d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:41.462989 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-804c886b-3f1c-4c94-a7a2-eb5d70a3872d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:41.463493 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-804c886b-3f1c-4c94-a7a2-eb5d70a3872d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:41.464566 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-804c886b-3f1c-4c94-a7a2-eb5d70a3872d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:41.465156 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-804c886b-3f1c-4c94-a7a2-eb5d70a3872d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:41.626504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-804c886b-3f1c-4c94-a7a2-eb5d70a3872d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:41.641212 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-804c886b-3f1c-4c94-a7a2-eb5d70a3872d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1274 microversion: 2.1 time: 0.212980 Jun 15 15:51:41.641804 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 111/228] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:41 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:41.745990 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-db3a0014-4477-44e5-a4f9-04030c627733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:41.746600 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-db3a0014-4477-44e5-a4f9-04030c627733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:41.753094 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-db3a0014-4477-44e5-a4f9-04030c627733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:41.753533 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-db3a0014-4477-44e5-a4f9-04030c627733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:41.755068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-db3a0014-4477-44e5-a4f9-04030c627733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:41.755651 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-db3a0014-4477-44e5-a4f9-04030c627733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:41.972832 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-db3a0014-4477-44e5-a4f9-04030c627733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:41.981037 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-db3a0014-4477-44e5-a4f9-04030c627733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1222 microversion: 2.1 time: 0.239097 Jun 15 15:51:41.984633 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 112/229] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:41 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1222 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:42.001483 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-aa7bc792-cc41-4ebf-b073-5e923b6976e3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:42.023095 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-aa7bc792-cc41-4ebf-b073-5e923b6976e3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.753148 Jun 15 15:51:42.023678 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 118/230] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:41 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:42.321211 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-89900339-fa0d-422a-b944-57af4d6475f6 req-0e04ba69-8db3-4bd7-819b-b8422dfe01a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd3fc6c-1f7c-4460-9d14-374fb27cd077", "tag": "66583eec-a8aa-4d4f-9126-61ff9dca3d25"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:42.338599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-89900339-fa0d-422a-b944-57af4d6475f6 req-0e04ba69-8db3-4bd7-819b-b8422dfe01a3 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:42.339322 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-89900339-fa0d-422a-b944-57af4d6475f6 req-0e04ba69-8db3-4bd7-819b-b8422dfe01a3 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:42.383777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-89900339-fa0d-422a-b944-57af4d6475f6 req-0e04ba69-8db3-4bd7-819b-b8422dfe01a3 service nova] Creating event network-changed:66583eec-a8aa-4d4f-9126-61ff9dca3d25 for instance dfd3fc6c-1f7c-4460-9d14-374fb27cd077 on hv-cinder-84599 Jun 15 15:51:42.396574 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-89900339-fa0d-422a-b944-57af4d6475f6 req-0e04ba69-8db3-4bd7-819b-b8422dfe01a3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080960 Jun 15 15:51:42.399132 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 113/231] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:51:42.660572 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-851073ac-df3b-4799-b145-3a8fe917eeeb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:42.661321 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-851073ac-df3b-4799-b145-3a8fe917eeeb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:42.668232 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-851073ac-df3b-4799-b145-3a8fe917eeeb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:42.668671 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-851073ac-df3b-4799-b145-3a8fe917eeeb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:42.669454 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-851073ac-df3b-4799-b145-3a8fe917eeeb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:42.670059 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-851073ac-df3b-4799-b145-3a8fe917eeeb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:42.779182 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-851073ac-df3b-4799-b145-3a8fe917eeeb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:42.790468 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-851073ac-df3b-4799-b145-3a8fe917eeeb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1280 microversion: 2.1 time: 0.136197 Jun 15 15:51:42.791541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 119/232] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:42 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1280 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:43.012561 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8f4ab9ca-76e8-4ccc-abbc-a55a50a650ba tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:43.013818 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-8f4ab9ca-76e8-4ccc-abbc-a55a50a650ba tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:43.029145 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8f4ab9ca-76e8-4ccc-abbc-a55a50a650ba tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:43.030163 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8f4ab9ca-76e8-4ccc-abbc-a55a50a650ba tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:43.031371 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8f4ab9ca-76e8-4ccc-abbc-a55a50a650ba tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:43.032061 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8f4ab9ca-76e8-4ccc-abbc-a55a50a650ba tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:43.041227 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d3225e28-40a4-4f2b-b56f-2f41b5f4d8ec tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:43.042751 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d3225e28-40a4-4f2b-b56f-2f41b5f4d8ec tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:43.057194 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d3225e28-40a4-4f2b-b56f-2f41b5f4d8ec tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:43.059281 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d3225e28-40a4-4f2b-b56f-2f41b5f4d8ec tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:43.060486 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d3225e28-40a4-4f2b-b56f-2f41b5f4d8ec tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:43.061637 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d3225e28-40a4-4f2b-b56f-2f41b5f4d8ec tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:43.184029 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8f4ab9ca-76e8-4ccc-abbc-a55a50a650ba tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:43.199863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-8f4ab9ca-76e8-4ccc-abbc-a55a50a650ba tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1278 microversion: 2.1 time: 0.198668 Jun 15 15:51:43.200971 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 114/233] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:42 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:43.315222 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d3225e28-40a4-4f2b-b56f-2f41b5f4d8ec tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:43.323024 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d3225e28-40a4-4f2b-b56f-2f41b5f4d8ec tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.285911 Jun 15 15:51:43.323593 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 120/234] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:43 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:43.560035 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-9b2f6f46-52ab-46bf-b03c-afc0977e4035 req-058b9536-79b6-4e8a-bd3f-1c00ed4ab5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c08c200b-6119-4bc7-955c-448d9956f01e", "tag": "7022cf0a-9603-4a0a-856b-1193a989d68f"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:43.606342 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-9b2f6f46-52ab-46bf-b03c-afc0977e4035 req-058b9536-79b6-4e8a-bd3f-1c00ed4ab5fd service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:43.609072 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-9b2f6f46-52ab-46bf-b03c-afc0977e4035 req-058b9536-79b6-4e8a-bd3f-1c00ed4ab5fd service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:43.648446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-9b2f6f46-52ab-46bf-b03c-afc0977e4035 req-058b9536-79b6-4e8a-bd3f-1c00ed4ab5fd service nova] Creating event network-changed:7022cf0a-9603-4a0a-856b-1193a989d68f for instance c08c200b-6119-4bc7-955c-448d9956f01e on hv-cinder-84599 Jun 15 15:51:43.658923 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-9b2f6f46-52ab-46bf-b03c-afc0977e4035 req-058b9536-79b6-4e8a-bd3f-1c00ed4ab5fd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101507 Jun 15 15:51:43.659618 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 115/235] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:51:43.808728 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d17f5528-a863-4ba8-9dc4-ac292b7cfabc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:43.809337 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d17f5528-a863-4ba8-9dc4-ac292b7cfabc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:43.824301 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d17f5528-a863-4ba8-9dc4-ac292b7cfabc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:43.825042 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d17f5528-a863-4ba8-9dc4-ac292b7cfabc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:43.827237 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d17f5528-a863-4ba8-9dc4-ac292b7cfabc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:43.829690 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d17f5528-a863-4ba8-9dc4-ac292b7cfabc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:43.912557 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d17f5528-a863-4ba8-9dc4-ac292b7cfabc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:43.922502 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d17f5528-a863-4ba8-9dc4-ac292b7cfabc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1280 microversion: 2.1 time: 0.117957 Jun 15 15:51:43.923213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 121/236] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:43 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1280 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:44.223654 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4e7ebabb-d0bb-4d5e-8402-50eefa9b927c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:44.227633 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4e7ebabb-d0bb-4d5e-8402-50eefa9b927c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:44.239234 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4e7ebabb-d0bb-4d5e-8402-50eefa9b927c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:44.240357 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4e7ebabb-d0bb-4d5e-8402-50eefa9b927c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:44.242430 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4e7ebabb-d0bb-4d5e-8402-50eefa9b927c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:44.243111 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4e7ebabb-d0bb-4d5e-8402-50eefa9b927c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:44.339958 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-03ab158c-7167-4776-b4a2-1e9a15f742a8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:44.340550 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-03ab158c-7167-4776-b4a2-1e9a15f742a8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:44.349435 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-03ab158c-7167-4776-b4a2-1e9a15f742a8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:44.352586 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-03ab158c-7167-4776-b4a2-1e9a15f742a8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:44.353638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-03ab158c-7167-4776-b4a2-1e9a15f742a8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:44.354082 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-03ab158c-7167-4776-b4a2-1e9a15f742a8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:44.465171 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4e7ebabb-d0bb-4d5e-8402-50eefa9b927c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:44.475965 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4e7ebabb-d0bb-4d5e-8402-50eefa9b927c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.261988 Jun 15 15:51:44.486211 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 116/237] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:44 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:44.553605 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-03ab158c-7167-4776-b4a2-1e9a15f742a8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:44.561633 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-03ab158c-7167-4776-b4a2-1e9a15f742a8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.225262 Jun 15 15:51:44.562205 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 122/238] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:44 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:44.939185 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-21da46d1-f101-4907-b6e9-1f17aee5c62d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:44.939795 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-21da46d1-f101-4907-b6e9-1f17aee5c62d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:44.946760 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21da46d1-f101-4907-b6e9-1f17aee5c62d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:44.947219 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21da46d1-f101-4907-b6e9-1f17aee5c62d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:44.947986 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21da46d1-f101-4907-b6e9-1f17aee5c62d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:44.948416 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21da46d1-f101-4907-b6e9-1f17aee5c62d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:45.082700 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-21da46d1-f101-4907-b6e9-1f17aee5c62d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:45.090262 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-21da46d1-f101-4907-b6e9-1f17aee5c62d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.154889 Jun 15 15:51:45.090978 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 117/239] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:44 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:45.493708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a046d8d6-4d6e-467f-8895-78c5f88ef207 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:45.494326 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a046d8d6-4d6e-467f-8895-78c5f88ef207 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:45.500869 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a046d8d6-4d6e-467f-8895-78c5f88ef207 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:45.501412 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a046d8d6-4d6e-467f-8895-78c5f88ef207 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:45.502257 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a046d8d6-4d6e-467f-8895-78c5f88ef207 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:45.502806 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a046d8d6-4d6e-467f-8895-78c5f88ef207 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:45.582389 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1364500e-e1d5-4574-9cb4-eb354c8ec528 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:45.583362 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1364500e-e1d5-4574-9cb4-eb354c8ec528 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:45.590043 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1364500e-e1d5-4574-9cb4-eb354c8ec528 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:45.590680 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1364500e-e1d5-4574-9cb4-eb354c8ec528 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:45.591652 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1364500e-e1d5-4574-9cb4-eb354c8ec528 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:45.592222 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1364500e-e1d5-4574-9cb4-eb354c8ec528 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:45.633727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a046d8d6-4d6e-467f-8895-78c5f88ef207 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:45.644350 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a046d8d6-4d6e-467f-8895-78c5f88ef207 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.155088 Jun 15 15:51:45.652065 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 123/240] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:45 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:45.738565 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1364500e-e1d5-4574-9cb4-eb354c8ec528 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:45.746486 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1364500e-e1d5-4574-9cb4-eb354c8ec528 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.172381 Jun 15 15:51:45.747211 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 118/241] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:45 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:46.107440 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-70cde0c2-bca1-44d4-a770-ddd80610b131 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:46.108600 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-70cde0c2-bca1-44d4-a770-ddd80610b131 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:46.115129 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-70cde0c2-bca1-44d4-a770-ddd80610b131 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:46.115580 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-70cde0c2-bca1-44d4-a770-ddd80610b131 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:46.116339 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-70cde0c2-bca1-44d4-a770-ddd80610b131 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:46.116768 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-70cde0c2-bca1-44d4-a770-ddd80610b131 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:46.391778 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-70cde0c2-bca1-44d4-a770-ddd80610b131 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:46.400661 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-70cde0c2-bca1-44d4-a770-ddd80610b131 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.297055 Jun 15 15:51:46.410475 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 124/242] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:46 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:46.662164 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5e8794b1-e356-42fb-a79a-6027cf086aad tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:46.662712 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5e8794b1-e356-42fb-a79a-6027cf086aad tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:46.669334 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5e8794b1-e356-42fb-a79a-6027cf086aad tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:46.669805 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5e8794b1-e356-42fb-a79a-6027cf086aad tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:46.670562 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5e8794b1-e356-42fb-a79a-6027cf086aad tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:46.671039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5e8794b1-e356-42fb-a79a-6027cf086aad tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:46.763696 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-78516c15-7efc-4a60-89c0-9ee64312a73a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:46.765140 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-78516c15-7efc-4a60-89c0-9ee64312a73a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:46.771524 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78516c15-7efc-4a60-89c0-9ee64312a73a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:46.771977 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78516c15-7efc-4a60-89c0-9ee64312a73a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:46.772747 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78516c15-7efc-4a60-89c0-9ee64312a73a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:46.773181 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78516c15-7efc-4a60-89c0-9ee64312a73a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:46.797161 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5e8794b1-e356-42fb-a79a-6027cf086aad tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:46.804741 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5e8794b1-e356-42fb-a79a-6027cf086aad tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.146673 Jun 15 15:51:46.805313 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 119/243] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:46 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:46.903596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-78516c15-7efc-4a60-89c0-9ee64312a73a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:46.911161 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-78516c15-7efc-4a60-89c0-9ee64312a73a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.151156 Jun 15 15:51:46.911729 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 125/244] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:46 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:47.417955 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-024b1ddc-3489-4109-9e37-2b351410fe27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:47.418563 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-024b1ddc-3489-4109-9e37-2b351410fe27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:47.425162 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-024b1ddc-3489-4109-9e37-2b351410fe27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:47.425614 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-024b1ddc-3489-4109-9e37-2b351410fe27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:47.426368 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-024b1ddc-3489-4109-9e37-2b351410fe27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:47.426836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-024b1ddc-3489-4109-9e37-2b351410fe27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:47.552393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-024b1ddc-3489-4109-9e37-2b351410fe27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:47.559838 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-024b1ddc-3489-4109-9e37-2b351410fe27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.145699 Jun 15 15:51:47.560388 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 120/245] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:47 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:47.821644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b45fbf7f-105f-4aae-a9c9-29f9dd1fe53e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:47.822278 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b45fbf7f-105f-4aae-a9c9-29f9dd1fe53e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:47.829210 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b45fbf7f-105f-4aae-a9c9-29f9dd1fe53e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:47.829762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b45fbf7f-105f-4aae-a9c9-29f9dd1fe53e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:47.830595 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b45fbf7f-105f-4aae-a9c9-29f9dd1fe53e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:47.831173 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b45fbf7f-105f-4aae-a9c9-29f9dd1fe53e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:47.927307 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fb7433cd-dfb6-471c-9ef2-136c3c46e038 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:47.927914 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fb7433cd-dfb6-471c-9ef2-136c3c46e038 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:47.934033 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb7433cd-dfb6-471c-9ef2-136c3c46e038 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:47.934558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb7433cd-dfb6-471c-9ef2-136c3c46e038 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:47.935366 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb7433cd-dfb6-471c-9ef2-136c3c46e038 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:47.935802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb7433cd-dfb6-471c-9ef2-136c3c46e038 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:47.961753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b45fbf7f-105f-4aae-a9c9-29f9dd1fe53e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:47.969146 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b45fbf7f-105f-4aae-a9c9-29f9dd1fe53e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.151289 Jun 15 15:51:47.969707 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 126/246] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:47 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:48.065245 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fb7433cd-dfb6-471c-9ef2-136c3c46e038 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:48.073516 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fb7433cd-dfb6-471c-9ef2-136c3c46e038 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.149920 Jun 15 15:51:48.074098 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 121/247] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:47 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:48.576478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4fe6c10f-06f4-4894-9aec-e1a472583afa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:48.577077 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4fe6c10f-06f4-4894-9aec-e1a472583afa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:48.582947 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4fe6c10f-06f4-4894-9aec-e1a472583afa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:48.583387 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4fe6c10f-06f4-4894-9aec-e1a472583afa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:48.584137 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4fe6c10f-06f4-4894-9aec-e1a472583afa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:48.584561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4fe6c10f-06f4-4894-9aec-e1a472583afa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:48.804253 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4fe6c10f-06f4-4894-9aec-e1a472583afa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:48.812454 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4fe6c10f-06f4-4894-9aec-e1a472583afa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.239625 Jun 15 15:51:48.813117 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 127/248] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:48 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:48.986505 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-bd6ad5b3-f626-4795-9730-44586d4a6733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:48.987443 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-bd6ad5b3-f626-4795-9730-44586d4a6733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:48.995193 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bd6ad5b3-f626-4795-9730-44586d4a6733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:48.995695 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bd6ad5b3-f626-4795-9730-44586d4a6733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:48.996569 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bd6ad5b3-f626-4795-9730-44586d4a6733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:48.997243 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bd6ad5b3-f626-4795-9730-44586d4a6733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:49.090419 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a0f9e21e-b66f-4f8c-ac50-287421b0c59e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:49.091209 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a0f9e21e-b66f-4f8c-ac50-287421b0c59e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:49.098382 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a0f9e21e-b66f-4f8c-ac50-287421b0c59e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:49.099028 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a0f9e21e-b66f-4f8c-ac50-287421b0c59e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:49.099900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a0f9e21e-b66f-4f8c-ac50-287421b0c59e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:49.100423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a0f9e21e-b66f-4f8c-ac50-287421b0c59e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:49.465504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-bd6ad5b3-f626-4795-9730-44586d4a6733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:49.469739 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a0f9e21e-b66f-4f8c-ac50-287421b0c59e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:49.473272 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-bd6ad5b3-f626-4795-9730-44586d4a6733 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.491222 Jun 15 15:51:49.474183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 122/249] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:48 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:49.477864 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a0f9e21e-b66f-4f8c-ac50-287421b0c59e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.391182 Jun 15 15:51:49.486457 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 128/250] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:49 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:49.830098 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0235f0a5-5b00-49c5-aa30-8bf20b576f77 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:49.830702 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0235f0a5-5b00-49c5-aa30-8bf20b576f77 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:49.832976 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=6 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:49.838893 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0235f0a5-5b00-49c5-aa30-8bf20b576f77 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:49.839334 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0235f0a5-5b00-49c5-aa30-8bf20b576f77 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:49.840095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0235f0a5-5b00-49c5-aa30-8bf20b576f77 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:49.840524 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0235f0a5-5b00-49c5-aa30-8bf20b576f77 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:49.994446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0235f0a5-5b00-49c5-aa30-8bf20b576f77 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:50.002513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0235f0a5-5b00-49c5-aa30-8bf20b576f77 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.177167 Jun 15 15:51:50.003190 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 123/251] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:49 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:50.172409 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-bfd356c0-aeef-4911-bb7c-ee9ed875f25e req-7f5d91ef-561e-4d2d-b15f-c8914d6f4c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3072d511-e603-4222-9e8e-69370d441b30", "tag": "cb323fdc-7e88-452a-bf55-5b8f63d4e576"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:50.181439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-bfd356c0-aeef-4911-bb7c-ee9ed875f25e req-7f5d91ef-561e-4d2d-b15f-c8914d6f4c27 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:50.182131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-bfd356c0-aeef-4911-bb7c-ee9ed875f25e req-7f5d91ef-561e-4d2d-b15f-c8914d6f4c27 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:50.195102 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-bfd356c0-aeef-4911-bb7c-ee9ed875f25e req-7f5d91ef-561e-4d2d-b15f-c8914d6f4c27 service nova] Creating event network-changed:cb323fdc-7e88-452a-bf55-5b8f63d4e576 for instance 3072d511-e603-4222-9e8e-69370d441b30 on hv-cinder-84599 Jun 15 15:51:50.200552 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-bfd356c0-aeef-4911-bb7c-ee9ed875f25e req-7f5d91ef-561e-4d2d-b15f-c8914d6f4c27 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031818 Jun 15 15:51:50.201340 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 129/252] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:51:50.490279 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f98b673c-2ff4-41eb-a8dd-7d4b6b03a67b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:50.490922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f98b673c-2ff4-41eb-a8dd-7d4b6b03a67b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:50.492252 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:50.493033 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=10 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:50.497167 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b26b2dcb-0e7d-4c29-9209-af62363e8bfd tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:50.497309 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f98b673c-2ff4-41eb-a8dd-7d4b6b03a67b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:50.497679 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f98b673c-2ff4-41eb-a8dd-7d4b6b03a67b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:50.497854 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b26b2dcb-0e7d-4c29-9209-af62363e8bfd tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:50.498437 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f98b673c-2ff4-41eb-a8dd-7d4b6b03a67b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:50.499452 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f98b673c-2ff4-41eb-a8dd-7d4b6b03a67b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:50.505668 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b26b2dcb-0e7d-4c29-9209-af62363e8bfd tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:50.506114 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b26b2dcb-0e7d-4c29-9209-af62363e8bfd tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:50.506901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b26b2dcb-0e7d-4c29-9209-af62363e8bfd tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:50.507332 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b26b2dcb-0e7d-4c29-9209-af62363e8bfd tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:50.517162 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=100 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:50.689941 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f98b673c-2ff4-41eb-a8dd-7d4b6b03a67b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:50.693373 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b26b2dcb-0e7d-4c29-9209-af62363e8bfd tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:50.697622 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f98b673c-2ff4-41eb-a8dd-7d4b6b03a67b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.211157 Jun 15 15:51:50.698297 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 124/253] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:50 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:50.700923 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b26b2dcb-0e7d-4c29-9209-af62363e8bfd tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.209507 Jun 15 15:51:50.701533 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 130/254] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:50 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:51.019370 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d48c3e7d-33e8-4a53-9949-2b7448fadf15 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:51.019975 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d48c3e7d-33e8-4a53-9949-2b7448fadf15 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:51.021827 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=22 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:51.027786 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d48c3e7d-33e8-4a53-9949-2b7448fadf15 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:51.028240 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d48c3e7d-33e8-4a53-9949-2b7448fadf15 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:51.029032 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d48c3e7d-33e8-4a53-9949-2b7448fadf15 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:51.029467 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d48c3e7d-33e8-4a53-9949-2b7448fadf15 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:51.156851 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d48c3e7d-33e8-4a53-9949-2b7448fadf15 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:51.164527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d48c3e7d-33e8-4a53-9949-2b7448fadf15 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.148950 Jun 15 15:51:51.165172 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 125/255] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:51 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:51.714580 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-771a23fa-2389-4b2b-a741-f17b98851150 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:51.717222 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f93fe3b2-a3f3-4ed2-81ab-61e0c5ca41fc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:51.717406 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-771a23fa-2389-4b2b-a741-f17b98851150 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:51.718123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f93fe3b2-a3f3-4ed2-81ab-61e0c5ca41fc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:51.724444 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-771a23fa-2389-4b2b-a741-f17b98851150 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:51.724887 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-771a23fa-2389-4b2b-a741-f17b98851150 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:51.725680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-771a23fa-2389-4b2b-a741-f17b98851150 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:51.726107 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-771a23fa-2389-4b2b-a741-f17b98851150 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:51.727086 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f93fe3b2-a3f3-4ed2-81ab-61e0c5ca41fc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:51.727663 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f93fe3b2-a3f3-4ed2-81ab-61e0c5ca41fc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:51.728463 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f93fe3b2-a3f3-4ed2-81ab-61e0c5ca41fc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:51.729314 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f93fe3b2-a3f3-4ed2-81ab-61e0c5ca41fc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:51.929193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-771a23fa-2389-4b2b-a741-f17b98851150 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:51.937418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-771a23fa-2389-4b2b-a741-f17b98851150 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.226736 Jun 15 15:51:51.937976 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 131/256] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:51 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:51.944018 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f93fe3b2-a3f3-4ed2-81ab-61e0c5ca41fc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:51.957867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f93fe3b2-a3f3-4ed2-81ab-61e0c5ca41fc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.244562 Jun 15 15:51:51.958473 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 126/257] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:51 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:52.181571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-21094ce8-5dce-474f-9dcf-68e815114175 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:52.182175 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-21094ce8-5dce-474f-9dcf-68e815114175 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:52.184097 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:52.189352 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21094ce8-5dce-474f-9dcf-68e815114175 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:52.189798 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21094ce8-5dce-474f-9dcf-68e815114175 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:52.190557 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21094ce8-5dce-474f-9dcf-68e815114175 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:52.191014 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21094ce8-5dce-474f-9dcf-68e815114175 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:52.214958 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-4d288391-eae2-487c-abca-cd241ef92b0c req-18673fe6-4e31-43c8-bcda-3468ce76101e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd894d3e-d369-42df-80c8-fb5ae7ed03ea", "tag": "fb40b76c-ac84-484b-9777-63cbb798edb4"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:52.224194 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-4d288391-eae2-487c-abca-cd241ef92b0c req-18673fe6-4e31-43c8-bcda-3468ce76101e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:52.224634 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-4d288391-eae2-487c-abca-cd241ef92b0c req-18673fe6-4e31-43c8-bcda-3468ce76101e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:52.238183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-4d288391-eae2-487c-abca-cd241ef92b0c req-18673fe6-4e31-43c8-bcda-3468ce76101e service nova] Creating event network-changed:fb40b76c-ac84-484b-9777-63cbb798edb4 for instance cd894d3e-d369-42df-80c8-fb5ae7ed03ea on hv-cinder-84599 Jun 15 15:51:52.243832 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-4d288391-eae2-487c-abca-cd241ef92b0c req-18673fe6-4e31-43c8-bcda-3468ce76101e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032124 Jun 15 15:51:52.244874 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 127/258] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:51:52.329375 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-21094ce8-5dce-474f-9dcf-68e815114175 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:52.336679 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-21094ce8-5dce-474f-9dcf-68e815114175 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.159061 Jun 15 15:51:52.337230 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 132/259] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:52 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:52.954135 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d578f910-94ef-4eeb-99af-966cd3c8c1e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:52.954892 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d578f910-94ef-4eeb-99af-966cd3c8c1e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:52.956816 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:52.962140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d578f910-94ef-4eeb-99af-966cd3c8c1e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:52.962582 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d578f910-94ef-4eeb-99af-966cd3c8c1e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:52.963371 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d578f910-94ef-4eeb-99af-966cd3c8c1e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:52.963801 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d578f910-94ef-4eeb-99af-966cd3c8c1e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:52.973974 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-53173ac2-c4fb-4179-9d63-3ba407974d1a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:52.974580 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-53173ac2-c4fb-4179-9d63-3ba407974d1a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:52.980486 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-53173ac2-c4fb-4179-9d63-3ba407974d1a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:52.980927 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-53173ac2-c4fb-4179-9d63-3ba407974d1a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:52.981681 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-53173ac2-c4fb-4179-9d63-3ba407974d1a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:52.982108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-53173ac2-c4fb-4179-9d63-3ba407974d1a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:53.166042 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d578f910-94ef-4eeb-99af-966cd3c8c1e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:53.173448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d578f910-94ef-4eeb-99af-966cd3c8c1e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.223582 Jun 15 15:51:53.174009 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 128/260] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:52 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:53.179503 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-53173ac2-c4fb-4179-9d63-3ba407974d1a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:53.187473 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-53173ac2-c4fb-4179-9d63-3ba407974d1a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.217219 Jun 15 15:51:53.188023 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 133/261] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:52 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:53.353042 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b643d81f-550f-420d-8461-19402aecb503 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:53.353568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b643d81f-550f-420d-8461-19402aecb503 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:53.360558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b643d81f-550f-420d-8461-19402aecb503 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:53.360998 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b643d81f-550f-420d-8461-19402aecb503 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:53.361748 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b643d81f-550f-420d-8461-19402aecb503 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:53.362177 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b643d81f-550f-420d-8461-19402aecb503 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:53.493512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b643d81f-550f-420d-8461-19402aecb503 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:53.501515 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b643d81f-550f-420d-8461-19402aecb503 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.152488 Jun 15 15:51:53.502081 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 129/262] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:53 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:54.189781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-807b59d4-d852-4f59-b461-128b0fde5e8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:54.190477 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-807b59d4-d852-4f59-b461-128b0fde5e8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:54.196443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-807b59d4-d852-4f59-b461-128b0fde5e8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:54.196892 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-807b59d4-d852-4f59-b461-128b0fde5e8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:54.197648 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-807b59d4-d852-4f59-b461-128b0fde5e8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:54.198079 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-807b59d4-d852-4f59-b461-128b0fde5e8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:54.202010 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:51:54.207608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7666d2b5-75b4-4eca-a0fd-f6d121bdbf88 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:54.208856 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7666d2b5-75b4-4eca-a0fd-f6d121bdbf88 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:54.215516 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7666d2b5-75b4-4eca-a0fd-f6d121bdbf88 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:54.215997 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7666d2b5-75b4-4eca-a0fd-f6d121bdbf88 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:54.216766 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7666d2b5-75b4-4eca-a0fd-f6d121bdbf88 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:54.217408 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7666d2b5-75b4-4eca-a0fd-f6d121bdbf88 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:54.422935 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-807b59d4-d852-4f59-b461-128b0fde5e8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:54.428596 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7666d2b5-75b4-4eca-a0fd-f6d121bdbf88 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:54.431363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-807b59d4-d852-4f59-b461-128b0fde5e8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.245924 Jun 15 15:51:54.442643 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 134/263] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:54 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:54.443942 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7666d2b5-75b4-4eca-a0fd-f6d121bdbf88 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.242743 Jun 15 15:51:54.444805 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 130/264] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:54 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:54.518961 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-56d891ea-51a6-4f38-b623-8283304db5c3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:54.519655 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-56d891ea-51a6-4f38-b623-8283304db5c3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:54.526464 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-56d891ea-51a6-4f38-b623-8283304db5c3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:54.526940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-56d891ea-51a6-4f38-b623-8283304db5c3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:54.527701 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-56d891ea-51a6-4f38-b623-8283304db5c3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:54.528130 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-56d891ea-51a6-4f38-b623-8283304db5c3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:54.594395 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-6ce1e4c2-d1c9-4dc0-b00a-02cd23a9ad84 req-6d156592-a7be-44b9-ac10-0f92b9ecfa3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd3fc6c-1f7c-4460-9d14-374fb27cd077", "name": "network-vif-plugged", "status": "completed", "tag": "66583eec-a8aa-4d4f-9126-61ff9dca3d25"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:51:54.603708 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-6ce1e4c2-d1c9-4dc0-b00a-02cd23a9ad84 req-6d156592-a7be-44b9-ac10-0f92b9ecfa3d service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:54.606691 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-6ce1e4c2-d1c9-4dc0-b00a-02cd23a9ad84 req-6d156592-a7be-44b9-ac10-0f92b9ecfa3d service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:54.619206 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-6ce1e4c2-d1c9-4dc0-b00a-02cd23a9ad84 req-6d156592-a7be-44b9-ac10-0f92b9ecfa3d service nova] Creating event network-vif-plugged:66583eec-a8aa-4d4f-9126-61ff9dca3d25 for instance dfd3fc6c-1f7c-4460-9d14-374fb27cd077 on hv-cinder-84599 Jun 15 15:51:54.624514 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-6ce1e4c2-d1c9-4dc0-b00a-02cd23a9ad84 req-6d156592-a7be-44b9-ac10-0f92b9ecfa3d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035135 Jun 15 15:51:54.625190 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 131/265] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:51:54.658796 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-56d891ea-51a6-4f38-b623-8283304db5c3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:54.666648 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-56d891ea-51a6-4f38-b623-8283304db5c3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.151702 Jun 15 15:51:54.667239 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 135/266] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:54 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:55.460163 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9dcc1c7c-b468-4332-96a1-e43cbc33165d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:55.460638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dbf0544f-9305-4f20-a03b-5789d110ecbb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:55.460995 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9dcc1c7c-b468-4332-96a1-e43cbc33165d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:55.461087 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-dbf0544f-9305-4f20-a03b-5789d110ecbb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:55.467095 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbf0544f-9305-4f20-a03b-5789d110ecbb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:55.467542 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbf0544f-9305-4f20-a03b-5789d110ecbb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:55.467786 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9dcc1c7c-b468-4332-96a1-e43cbc33165d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:55.468884 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbf0544f-9305-4f20-a03b-5789d110ecbb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:55.468992 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9dcc1c7c-b468-4332-96a1-e43cbc33165d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:55.469340 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbf0544f-9305-4f20-a03b-5789d110ecbb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:55.469646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9dcc1c7c-b468-4332-96a1-e43cbc33165d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:55.470079 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9dcc1c7c-b468-4332-96a1-e43cbc33165d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:55.665308 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dbf0544f-9305-4f20-a03b-5789d110ecbb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:55.667875 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9dcc1c7c-b468-4332-96a1-e43cbc33165d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:55.672731 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-dbf0544f-9305-4f20-a03b-5789d110ecbb tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.216040 Jun 15 15:51:55.673293 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 136/267] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:55 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:55.677057 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9dcc1c7c-b468-4332-96a1-e43cbc33165d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.221138 Jun 15 15:51:55.678903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 132/268] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:55 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:55.683624 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-45d1616a-bbdd-438c-a0c9-90909ada7cb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:55.684244 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-45d1616a-bbdd-438c-a0c9-90909ada7cb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:55.690539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-45d1616a-bbdd-438c-a0c9-90909ada7cb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:55.690997 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-45d1616a-bbdd-438c-a0c9-90909ada7cb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:55.691746 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-45d1616a-bbdd-438c-a0c9-90909ada7cb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:55.692176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-45d1616a-bbdd-438c-a0c9-90909ada7cb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:55.820608 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-45d1616a-bbdd-438c-a0c9-90909ada7cb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:55.828773 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-45d1616a-bbdd-438c-a0c9-90909ada7cb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.148881 Jun 15 15:51:55.829338 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 137/269] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:55 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:56.689136 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f50dfce9-4d77-4873-ab15-6eeedd2ca51f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:56.689742 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f50dfce9-4d77-4873-ab15-6eeedd2ca51f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:56.693947 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-78835ca8-2138-44cc-9a39-81bf7aaf1308 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:56.694562 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-78835ca8-2138-44cc-9a39-81bf7aaf1308 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:56.696327 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f50dfce9-4d77-4873-ab15-6eeedd2ca51f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:56.696774 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f50dfce9-4d77-4873-ab15-6eeedd2ca51f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:56.697542 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f50dfce9-4d77-4873-ab15-6eeedd2ca51f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:56.698030 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f50dfce9-4d77-4873-ab15-6eeedd2ca51f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:56.700482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78835ca8-2138-44cc-9a39-81bf7aaf1308 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:56.700935 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78835ca8-2138-44cc-9a39-81bf7aaf1308 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:56.701913 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78835ca8-2138-44cc-9a39-81bf7aaf1308 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:56.702278 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78835ca8-2138-44cc-9a39-81bf7aaf1308 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:56.897561 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f50dfce9-4d77-4873-ab15-6eeedd2ca51f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:56.902539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-78835ca8-2138-44cc-9a39-81bf7aaf1308 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:56.907071 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f50dfce9-4d77-4873-ab15-6eeedd2ca51f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.221216 Jun 15 15:51:56.908002 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 133/270] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:56 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:56.912875 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-88616534-fd39-4501-acdc-66d7324fea5d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:56.913878 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-88616534-fd39-4501-acdc-66d7324fea5d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:56.915312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-78835ca8-2138-44cc-9a39-81bf7aaf1308 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.225808 Jun 15 15:51:56.922758 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88616534-fd39-4501-acdc-66d7324fea5d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:56.923191 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88616534-fd39-4501-acdc-66d7324fea5d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:56.923949 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88616534-fd39-4501-acdc-66d7324fea5d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:56.924378 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88616534-fd39-4501-acdc-66d7324fea5d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:56.926051 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 138/271] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:56 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:57.163800 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-88616534-fd39-4501-acdc-66d7324fea5d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:57.171898 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-88616534-fd39-4501-acdc-66d7324fea5d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.262770 Jun 15 15:51:57.172469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 134/272] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:56 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:57.923979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5e069a13-231c-46d4-93bc-a925778bc040 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:57.924682 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5e069a13-231c-46d4-93bc-a925778bc040 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:57.931987 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5e069a13-231c-46d4-93bc-a925778bc040 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:57.932438 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5e069a13-231c-46d4-93bc-a925778bc040 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:57.933201 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5e069a13-231c-46d4-93bc-a925778bc040 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:57.933513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-424c65e3-2a32-45f3-960f-a8582cd35042 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:57.933918 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5e069a13-231c-46d4-93bc-a925778bc040 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:57.934218 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-424c65e3-2a32-45f3-960f-a8582cd35042 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:57.941462 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-424c65e3-2a32-45f3-960f-a8582cd35042 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:57.941976 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-424c65e3-2a32-45f3-960f-a8582cd35042 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:57.942966 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-424c65e3-2a32-45f3-960f-a8582cd35042 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:57.943462 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-424c65e3-2a32-45f3-960f-a8582cd35042 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:58.116694 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5e069a13-231c-46d4-93bc-a925778bc040 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:58.125583 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5e069a13-231c-46d4-93bc-a925778bc040 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.205440 Jun 15 15:51:58.126165 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 139/273] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:57 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:58.189090 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5279c63e-55c9-4a24-b96f-6357079620f4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:58.189850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5279c63e-55c9-4a24-b96f-6357079620f4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:58.200672 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5279c63e-55c9-4a24-b96f-6357079620f4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:58.201259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5279c63e-55c9-4a24-b96f-6357079620f4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:58.202130 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5279c63e-55c9-4a24-b96f-6357079620f4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:58.203241 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5279c63e-55c9-4a24-b96f-6357079620f4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:58.337416 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-424c65e3-2a32-45f3-960f-a8582cd35042 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:58.351575 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-424c65e3-2a32-45f3-960f-a8582cd35042 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.422363 Jun 15 15:51:58.352826 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 135/274] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:57 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:58.394394 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5279c63e-55c9-4a24-b96f-6357079620f4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:58.402367 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5279c63e-55c9-4a24-b96f-6357079620f4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.217613 Jun 15 15:51:58.403380 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 140/275] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:58 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:51:59.142682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-db61ded8-22fe-4817-8fa7-2c57aae927a3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:59.143378 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-db61ded8-22fe-4817-8fa7-2c57aae927a3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:59.149627 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-db61ded8-22fe-4817-8fa7-2c57aae927a3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:59.150256 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-db61ded8-22fe-4817-8fa7-2c57aae927a3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:59.151058 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-db61ded8-22fe-4817-8fa7-2c57aae927a3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:59.151486 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-db61ded8-22fe-4817-8fa7-2c57aae927a3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:59.287996 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-db61ded8-22fe-4817-8fa7-2c57aae927a3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:59.295361 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-db61ded8-22fe-4817-8fa7-2c57aae927a3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.156510 Jun 15 15:51:59.295923 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 136/276] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:59 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:59.368753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-60ac906a-5071-4fc3-8253-ace8307cc961 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:59.369355 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-60ac906a-5071-4fc3-8253-ace8307cc961 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:59.376116 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-60ac906a-5071-4fc3-8253-ace8307cc961 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:59.376719 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-60ac906a-5071-4fc3-8253-ace8307cc961 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:59.377466 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-60ac906a-5071-4fc3-8253-ace8307cc961 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:59.377887 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-60ac906a-5071-4fc3-8253-ace8307cc961 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:59.420280 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-741a7d82-49ef-4004-aef1-48388ee30ae2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:51:59.420923 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-741a7d82-49ef-4004-aef1-48388ee30ae2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:51:59.428419 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-741a7d82-49ef-4004-aef1-48388ee30ae2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:59.428874 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-741a7d82-49ef-4004-aef1-48388ee30ae2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:59.429624 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-741a7d82-49ef-4004-aef1-48388ee30ae2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:51:59.430275 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-741a7d82-49ef-4004-aef1-48388ee30ae2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:51:59.577917 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-60ac906a-5071-4fc3-8253-ace8307cc961 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:59.585583 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-60ac906a-5071-4fc3-8253-ace8307cc961 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.220486 Jun 15 15:51:59.586150 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 141/277] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:59 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:51:59.609565 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-741a7d82-49ef-4004-aef1-48388ee30ae2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:51:59.616971 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-741a7d82-49ef-4004-aef1-48388ee30ae2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.201532 Jun 15 15:51:59.617530 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 137/278] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:51:59 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:00.312387 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c247ae5b-6871-4488-8d23-ac671be5550a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:00.312985 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c247ae5b-6871-4488-8d23-ac671be5550a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:00.319033 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c247ae5b-6871-4488-8d23-ac671be5550a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:00.319467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c247ae5b-6871-4488-8d23-ac671be5550a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:00.320210 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c247ae5b-6871-4488-8d23-ac671be5550a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:00.320633 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c247ae5b-6871-4488-8d23-ac671be5550a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:00.445265 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c247ae5b-6871-4488-8d23-ac671be5550a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:00.452821 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c247ae5b-6871-4488-8d23-ac671be5550a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.144276 Jun 15 15:52:00.453380 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 142/279] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:00 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:00.602666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-843eebbb-e7c2-45fe-9b47-478ee9788de1 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:00.603233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-843eebbb-e7c2-45fe-9b47-478ee9788de1 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:00.610946 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-843eebbb-e7c2-45fe-9b47-478ee9788de1 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:00.611386 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-843eebbb-e7c2-45fe-9b47-478ee9788de1 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:00.612133 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-843eebbb-e7c2-45fe-9b47-478ee9788de1 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:00.612559 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-843eebbb-e7c2-45fe-9b47-478ee9788de1 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:00.633205 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d1f4bb63-e9d7-4859-b00c-cb0ee5e4f858 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:00.633814 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d1f4bb63-e9d7-4859-b00c-cb0ee5e4f858 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:00.639900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1f4bb63-e9d7-4859-b00c-cb0ee5e4f858 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:00.640345 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1f4bb63-e9d7-4859-b00c-cb0ee5e4f858 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:00.641103 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1f4bb63-e9d7-4859-b00c-cb0ee5e4f858 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:00.641543 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1f4bb63-e9d7-4859-b00c-cb0ee5e4f858 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:00.806713 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-843eebbb-e7c2-45fe-9b47-478ee9788de1 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:00.813459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d1f4bb63-e9d7-4859-b00c-cb0ee5e4f858 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:00.814337 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-843eebbb-e7c2-45fe-9b47-478ee9788de1 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.215559 Jun 15 15:52:00.815034 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 138/280] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:00 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:00.821306 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d1f4bb63-e9d7-4859-b00c-cb0ee5e4f858 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.191962 Jun 15 15:52:00.821853 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 143/281] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:00 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:01.469944 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7c702a63-eb39-4afa-a201-e1ab510aea79 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:01.470546 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7c702a63-eb39-4afa-a201-e1ab510aea79 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:01.477174 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c702a63-eb39-4afa-a201-e1ab510aea79 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:01.477611 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c702a63-eb39-4afa-a201-e1ab510aea79 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:01.478361 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c702a63-eb39-4afa-a201-e1ab510aea79 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:01.478812 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c702a63-eb39-4afa-a201-e1ab510aea79 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:01.603697 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7c702a63-eb39-4afa-a201-e1ab510aea79 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:01.611994 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7c702a63-eb39-4afa-a201-e1ab510aea79 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.146283 Jun 15 15:52:01.612551 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 139/282] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:01 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:01.831393 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3f77d418-8016-4def-b2d1-fbc0e2d6dcc7 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:01.832071 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3f77d418-8016-4def-b2d1-fbc0e2d6dcc7 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:01.837302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0e8c4cb4-0000-4cc1-b124-cd05b4027a32 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:01.837951 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0e8c4cb4-0000-4cc1-b124-cd05b4027a32 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:01.838134 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f77d418-8016-4def-b2d1-fbc0e2d6dcc7 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:01.838572 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f77d418-8016-4def-b2d1-fbc0e2d6dcc7 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:01.839355 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f77d418-8016-4def-b2d1-fbc0e2d6dcc7 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:01.839784 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f77d418-8016-4def-b2d1-fbc0e2d6dcc7 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:01.844354 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0e8c4cb4-0000-4cc1-b124-cd05b4027a32 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:01.844804 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0e8c4cb4-0000-4cc1-b124-cd05b4027a32 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:01.845570 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0e8c4cb4-0000-4cc1-b124-cd05b4027a32 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:01.846009 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0e8c4cb4-0000-4cc1-b124-cd05b4027a32 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:02.028794 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3f77d418-8016-4def-b2d1-fbc0e2d6dcc7 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:02.036815 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0e8c4cb4-0000-4cc1-b124-cd05b4027a32 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:02.038275 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3f77d418-8016-4def-b2d1-fbc0e2d6dcc7 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.210824 Jun 15 15:52:02.038718 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 144/283] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:01 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:02.049321 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0e8c4cb4-0000-4cc1-b124-cd05b4027a32 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.215921 Jun 15 15:52:02.050022 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 140/284] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:01 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:02.628811 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-207d8dfc-49c2-4ca2-b1bd-8e69d744e9f6 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:02.629413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-207d8dfc-49c2-4ca2-b1bd-8e69d744e9f6 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:02.635387 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-207d8dfc-49c2-4ca2-b1bd-8e69d744e9f6 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:02.635833 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-207d8dfc-49c2-4ca2-b1bd-8e69d744e9f6 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:02.636581 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-207d8dfc-49c2-4ca2-b1bd-8e69d744e9f6 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:02.637010 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-207d8dfc-49c2-4ca2-b1bd-8e69d744e9f6 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:02.764648 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-207d8dfc-49c2-4ca2-b1bd-8e69d744e9f6 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:02.772445 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-207d8dfc-49c2-4ca2-b1bd-8e69d744e9f6 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.148003 Jun 15 15:52:02.772998 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 145/285] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:02 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:03.055986 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b83c12cf-a7e2-41d3-8270-5a8c398da9ca tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:03.056827 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b83c12cf-a7e2-41d3-8270-5a8c398da9ca tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:03.063832 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b83c12cf-a7e2-41d3-8270-5a8c398da9ca tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:03.064397 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b83c12cf-a7e2-41d3-8270-5a8c398da9ca tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:03.065430 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b83c12cf-a7e2-41d3-8270-5a8c398da9ca tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:03.065893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e443eed3-3ba1-44a1-b3bb-fe1b21552558 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:03.066343 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b83c12cf-a7e2-41d3-8270-5a8c398da9ca tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:03.067117 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e443eed3-3ba1-44a1-b3bb-fe1b21552558 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:03.081185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e443eed3-3ba1-44a1-b3bb-fe1b21552558 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:03.081941 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e443eed3-3ba1-44a1-b3bb-fe1b21552558 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:03.083134 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e443eed3-3ba1-44a1-b3bb-fe1b21552558 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:03.083657 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e443eed3-3ba1-44a1-b3bb-fe1b21552558 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:03.265913 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b83c12cf-a7e2-41d3-8270-5a8c398da9ca tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:03.272459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e443eed3-3ba1-44a1-b3bb-fe1b21552558 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:03.273359 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b83c12cf-a7e2-41d3-8270-5a8c398da9ca tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.221766 Jun 15 15:52:03.273927 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 141/286] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:03 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:03.280452 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e443eed3-3ba1-44a1-b3bb-fe1b21552558 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.218822 Jun 15 15:52:03.281588 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 146/287] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:03 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:03.704049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-24981af7-ee3e-4e21-8da4-d208485b2228 req-e3f5f3e3-3c1f-45c0-9020-9e1b686b7f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08c200b-6119-4bc7-955c-448d9956f01e", "name": "network-vif-plugged", "status": "completed", "tag": "7022cf0a-9603-4a0a-856b-1193a989d68f"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:52:03.712564 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-24981af7-ee3e-4e21-8da4-d208485b2228 req-e3f5f3e3-3c1f-45c0-9020-9e1b686b7f7f service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:03.713006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-24981af7-ee3e-4e21-8da4-d208485b2228 req-e3f5f3e3-3c1f-45c0-9020-9e1b686b7f7f service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:03.725772 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-24981af7-ee3e-4e21-8da4-d208485b2228 req-e3f5f3e3-3c1f-45c0-9020-9e1b686b7f7f service nova] Creating event network-vif-plugged:7022cf0a-9603-4a0a-856b-1193a989d68f for instance c08c200b-6119-4bc7-955c-448d9956f01e on hv-cinder-84599 Jun 15 15:52:03.730635 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-24981af7-ee3e-4e21-8da4-d208485b2228 req-e3f5f3e3-3c1f-45c0-9020-9e1b686b7f7f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030947 Jun 15 15:52:03.731266 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 142/288] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:52:03.789712 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a4526c7e-869f-4a14-bd05-077dedc518e0 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:03.790423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a4526c7e-869f-4a14-bd05-077dedc518e0 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:03.797196 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a4526c7e-869f-4a14-bd05-077dedc518e0 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:03.797707 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a4526c7e-869f-4a14-bd05-077dedc518e0 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:03.798547 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a4526c7e-869f-4a14-bd05-077dedc518e0 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:03.799156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a4526c7e-869f-4a14-bd05-077dedc518e0 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:03.963749 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a4526c7e-869f-4a14-bd05-077dedc518e0 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:03.977228 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a4526c7e-869f-4a14-bd05-077dedc518e0 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1315 microversion: 2.1 time: 0.191835 Jun 15 15:52:03.977903 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 147/289] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:03 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:04.291765 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-bc90e8ce-fd19-4878-a177-8c528131407d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:04.292495 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-bc90e8ce-fd19-4878-a177-8c528131407d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:04.298314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c13c6aa5-f683-4718-a710-fd4b7d9df309 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:04.298951 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c13c6aa5-f683-4718-a710-fd4b7d9df309 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:04.299064 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bc90e8ce-fd19-4878-a177-8c528131407d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:04.299402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bc90e8ce-fd19-4878-a177-8c528131407d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:04.300167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bc90e8ce-fd19-4878-a177-8c528131407d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:04.300604 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-bc90e8ce-fd19-4878-a177-8c528131407d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:04.304674 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=100 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:52:04.304863 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c13c6aa5-f683-4718-a710-fd4b7d9df309 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:04.305869 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c13c6aa5-f683-4718-a710-fd4b7d9df309 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:04.306809 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c13c6aa5-f683-4718-a710-fd4b7d9df309 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:04.307406 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c13c6aa5-f683-4718-a710-fd4b7d9df309 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:04.490281 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-bc90e8ce-fd19-4878-a177-8c528131407d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:04.497003 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c13c6aa5-f683-4718-a710-fd4b7d9df309 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:04.497962 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-bc90e8ce-fd19-4878-a177-8c528131407d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.211166 Jun 15 15:52:04.498531 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 143/290] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:04 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:04.505013 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c13c6aa5-f683-4718-a710-fd4b7d9df309 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.210510 Jun 15 15:52:04.505572 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 148/291] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:04 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:04.993482 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-13310721-6e1f-453c-a6eb-356999a444d9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:04.994109 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-13310721-6e1f-453c-a6eb-356999a444d9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:05.000121 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-13310721-6e1f-453c-a6eb-356999a444d9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:05.000560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-13310721-6e1f-453c-a6eb-356999a444d9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:05.001314 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-13310721-6e1f-453c-a6eb-356999a444d9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:05.001744 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-13310721-6e1f-453c-a6eb-356999a444d9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:05.138040 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-13310721-6e1f-453c-a6eb-356999a444d9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:05.145990 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-13310721-6e1f-453c-a6eb-356999a444d9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1464 microversion: 2.1 time: 0.156462 Jun 15 15:52:05.146551 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 144/292] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:04 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:05.185694 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-378c65c3-f12f-4b08-ba6a-22c0f10cbb94 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:05.186318 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-378c65c3-f12f-4b08-ba6a-22c0f10cbb94 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:05.192484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-378c65c3-f12f-4b08-ba6a-22c0f10cbb94 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:05.192932 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-378c65c3-f12f-4b08-ba6a-22c0f10cbb94 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:05.193694 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-378c65c3-f12f-4b08-ba6a-22c0f10cbb94 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:05.194133 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-378c65c3-f12f-4b08-ba6a-22c0f10cbb94 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:05.219573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-378c65c3-f12f-4b08-ba6a-22c0f10cbb94 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Going to try to terminate instance {{(pid=123934) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:52:05.251097 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:52:05.293779 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-378c65c3-f12f-4b08-ba6a-22c0f10cbb94 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "DELETE /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 204 len: 0 microversion: 2.1 time: 0.111730 Jun 15 15:52:05.294346 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 149/293] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:52:05 2022] DELETE /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:52:05.302600 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9d961540-ac2a-47a6-b1b3-0f37bb83a510 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:05.303249 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9d961540-ac2a-47a6-b1b3-0f37bb83a510 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:05.309873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9d961540-ac2a-47a6-b1b3-0f37bb83a510 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:05.310321 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9d961540-ac2a-47a6-b1b3-0f37bb83a510 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:05.311115 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9d961540-ac2a-47a6-b1b3-0f37bb83a510 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:05.311557 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9d961540-ac2a-47a6-b1b3-0f37bb83a510 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:05.437772 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9d961540-ac2a-47a6-b1b3-0f37bb83a510 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:05.445342 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9d961540-ac2a-47a6-b1b3-0f37bb83a510 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.146609 Jun 15 15:52:05.445909 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 145/294] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:05 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:05.516025 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ff237047-1fdb-4362-98f6-afb10ddb174d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:05.516657 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ff237047-1fdb-4362-98f6-afb10ddb174d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:05.521588 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-88d08de6-656d-4db8-99f3-84c6e2a48d71 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:05.522193 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-88d08de6-656d-4db8-99f3-84c6e2a48d71 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:05.522636 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ff237047-1fdb-4362-98f6-afb10ddb174d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:05.523110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ff237047-1fdb-4362-98f6-afb10ddb174d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:05.523874 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ff237047-1fdb-4362-98f6-afb10ddb174d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:05.524304 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ff237047-1fdb-4362-98f6-afb10ddb174d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:05.528092 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88d08de6-656d-4db8-99f3-84c6e2a48d71 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:05.528537 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88d08de6-656d-4db8-99f3-84c6e2a48d71 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:05.529297 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88d08de6-656d-4db8-99f3-84c6e2a48d71 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:05.529729 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88d08de6-656d-4db8-99f3-84c6e2a48d71 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:05.709984 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ff237047-1fdb-4362-98f6-afb10ddb174d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:05.717327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ff237047-1fdb-4362-98f6-afb10ddb174d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.206161 Jun 15 15:52:05.717902 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 150/295] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:05 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:05.721046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-88d08de6-656d-4db8-99f3-84c6e2a48d71 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:05.728589 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-88d08de6-656d-4db8-99f3-84c6e2a48d71 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.210720 Jun 15 15:52:05.729150 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 146/296] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:05 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:06.463073 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1175b076-c42b-4390-ac7a-a010e1b24029 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:06.463676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1175b076-c42b-4390-ac7a-a010e1b24029 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:06.470223 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1175b076-c42b-4390-ac7a-a010e1b24029 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:06.470667 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1175b076-c42b-4390-ac7a-a010e1b24029 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:06.471442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1175b076-c42b-4390-ac7a-a010e1b24029 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:06.471869 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1175b076-c42b-4390-ac7a-a010e1b24029 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:06.599796 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1175b076-c42b-4390-ac7a-a010e1b24029 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:06.607405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1175b076-c42b-4390-ac7a-a010e1b24029 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.148166 Jun 15 15:52:06.607961 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 151/297] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:06 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:06.733359 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-37b2a10d-a277-4137-9389-572520c6f567 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:06.733887 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-37b2a10d-a277-4137-9389-572520c6f567 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:06.740333 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37b2a10d-a277-4137-9389-572520c6f567 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:06.740774 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37b2a10d-a277-4137-9389-572520c6f567 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:06.741527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37b2a10d-a277-4137-9389-572520c6f567 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:06.741951 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37b2a10d-a277-4137-9389-572520c6f567 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:06.744287 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-47c33e27-1bdb-4add-9160-3b2c9a1cb698 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:06.744895 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-47c33e27-1bdb-4add-9160-3b2c9a1cb698 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:06.750805 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47c33e27-1bdb-4add-9160-3b2c9a1cb698 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:06.751249 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47c33e27-1bdb-4add-9160-3b2c9a1cb698 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:06.751998 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47c33e27-1bdb-4add-9160-3b2c9a1cb698 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:06.752434 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47c33e27-1bdb-4add-9160-3b2c9a1cb698 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:06.938150 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-37b2a10d-a277-4137-9389-572520c6f567 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:06.941067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-47c33e27-1bdb-4add-9160-3b2c9a1cb698 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:06.945720 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-37b2a10d-a277-4137-9389-572520c6f567 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.216248 Jun 15 15:52:06.946286 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 147/298] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:06 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:06.948420 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-47c33e27-1bdb-4add-9160-3b2c9a1cb698 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.207906 Jun 15 15:52:06.948975 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 152/299] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:06 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:07.625603 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2ee2841c-7dd9-4de2-906f-673499f4668e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:07.626218 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2ee2841c-7dd9-4de2-906f-673499f4668e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:07.632560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2ee2841c-7dd9-4de2-906f-673499f4668e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:07.633019 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2ee2841c-7dd9-4de2-906f-673499f4668e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:07.633870 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2ee2841c-7dd9-4de2-906f-673499f4668e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:07.634312 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2ee2841c-7dd9-4de2-906f-673499f4668e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:07.784056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2ee2841c-7dd9-4de2-906f-673499f4668e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:07.792404 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2ee2841c-7dd9-4de2-906f-673499f4668e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.171226 Jun 15 15:52:07.793004 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 148/300] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:07 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:07.964328 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5c5e2375-27d7-4bc5-9540-269f36d9082c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:07.964949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5c5e2375-27d7-4bc5-9540-269f36d9082c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:07.971892 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5c5e2375-27d7-4bc5-9540-269f36d9082c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:07.972703 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5c5e2375-27d7-4bc5-9540-269f36d9082c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:07.972849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-22643d49-17ff-45cb-a72e-05820cd8aacb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:07.973441 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-22643d49-17ff-45cb-a72e-05820cd8aacb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:07.973570 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5c5e2375-27d7-4bc5-9540-269f36d9082c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:07.973912 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5c5e2375-27d7-4bc5-9540-269f36d9082c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:07.979847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-22643d49-17ff-45cb-a72e-05820cd8aacb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:07.980285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-22643d49-17ff-45cb-a72e-05820cd8aacb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:07.981042 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-22643d49-17ff-45cb-a72e-05820cd8aacb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:07.981467 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-22643d49-17ff-45cb-a72e-05820cd8aacb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:08.170460 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5c5e2375-27d7-4bc5-9540-269f36d9082c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:08.179414 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5c5e2375-27d7-4bc5-9540-269f36d9082c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.219838 Jun 15 15:52:08.180508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 153/301] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:07 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:08.186660 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-22643d49-17ff-45cb-a72e-05820cd8aacb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:08.196026 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-22643d49-17ff-45cb-a72e-05820cd8aacb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.226970 Jun 15 15:52:08.196591 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 149/302] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:07 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:08.809271 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-16bb67b8-6bf0-4905-bd5e-ca06121d360f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:08.809871 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-16bb67b8-6bf0-4905-bd5e-ca06121d360f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:08.815858 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16bb67b8-6bf0-4905-bd5e-ca06121d360f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:08.816300 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16bb67b8-6bf0-4905-bd5e-ca06121d360f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:08.817049 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16bb67b8-6bf0-4905-bd5e-ca06121d360f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:08.817475 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-16bb67b8-6bf0-4905-bd5e-ca06121d360f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:08.940100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-16bb67b8-6bf0-4905-bd5e-ca06121d360f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:08.947402 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-16bb67b8-6bf0-4905-bd5e-ca06121d360f tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.141984 Jun 15 15:52:08.947963 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 154/303] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:08 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:09.197440 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2de690a0-9c2b-449d-9381-4375ceaa93c5 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:09.198061 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2de690a0-9c2b-449d-9381-4375ceaa93c5 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:09.205187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2de690a0-9c2b-449d-9381-4375ceaa93c5 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:09.205681 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2de690a0-9c2b-449d-9381-4375ceaa93c5 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:09.206420 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2de690a0-9c2b-449d-9381-4375ceaa93c5 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:09.206938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2de690a0-9c2b-449d-9381-4375ceaa93c5 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:09.213903 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9c017f4d-1aed-49fe-a0e8-e9305321930d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:09.214517 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9c017f4d-1aed-49fe-a0e8-e9305321930d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:09.221026 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9c017f4d-1aed-49fe-a0e8-e9305321930d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:09.221472 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9c017f4d-1aed-49fe-a0e8-e9305321930d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:09.222237 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9c017f4d-1aed-49fe-a0e8-e9305321930d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:09.222675 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9c017f4d-1aed-49fe-a0e8-e9305321930d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:09.417926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2de690a0-9c2b-449d-9381-4375ceaa93c5 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:09.433382 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2de690a0-9c2b-449d-9381-4375ceaa93c5 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.238240 Jun 15 15:52:09.433978 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 150/304] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:09 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:09.446015 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-9c017f4d-1aed-49fe-a0e8-e9305321930d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:09.457540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9c017f4d-1aed-49fe-a0e8-e9305321930d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.248287 Jun 15 15:52:09.458443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 155/305] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:09 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:09.965192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-61b26898-079f-48a2-88c7-65c7a6adfb7b tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:09.965730 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-61b26898-079f-48a2-88c7-65c7a6adfb7b tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:09.973123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61b26898-079f-48a2-88c7-65c7a6adfb7b tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:09.973573 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61b26898-079f-48a2-88c7-65c7a6adfb7b tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:09.974338 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61b26898-079f-48a2-88c7-65c7a6adfb7b tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:09.974806 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61b26898-079f-48a2-88c7-65c7a6adfb7b tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:10.104515 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-61b26898-079f-48a2-88c7-65c7a6adfb7b tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:10.112984 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-61b26898-079f-48a2-88c7-65c7a6adfb7b tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.151685 Jun 15 15:52:10.113552 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 151/306] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:09 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:10.450104 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e1fdca5b-b513-415d-898f-9cb666c9f42f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:10.450705 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e1fdca5b-b513-415d-898f-9cb666c9f42f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:10.456864 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e1fdca5b-b513-415d-898f-9cb666c9f42f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:10.457231 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e1fdca5b-b513-415d-898f-9cb666c9f42f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:10.457983 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e1fdca5b-b513-415d-898f-9cb666c9f42f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:10.458413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e1fdca5b-b513-415d-898f-9cb666c9f42f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:10.474526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-927d82a4-adbe-45c9-8458-3cefafc83169 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:10.475951 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-927d82a4-adbe-45c9-8458-3cefafc83169 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:10.483024 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-927d82a4-adbe-45c9-8458-3cefafc83169 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:10.483469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-927d82a4-adbe-45c9-8458-3cefafc83169 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:10.484228 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-927d82a4-adbe-45c9-8458-3cefafc83169 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:10.485150 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-927d82a4-adbe-45c9-8458-3cefafc83169 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:10.653704 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e1fdca5b-b513-415d-898f-9cb666c9f42f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:10.658070 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-927d82a4-adbe-45c9-8458-3cefafc83169 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:10.662452 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e1fdca5b-b513-415d-898f-9cb666c9f42f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.215803 Jun 15 15:52:10.663595 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 156/307] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:10 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:10.666760 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-927d82a4-adbe-45c9-8458-3cefafc83169 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.195916 Jun 15 15:52:10.667668 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 152/308] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:10 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:11.129864 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-38194c37-665b-4f53-aa08-d8e96417a3a9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:11.130472 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-38194c37-665b-4f53-aa08-d8e96417a3a9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:11.136535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-38194c37-665b-4f53-aa08-d8e96417a3a9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:11.136981 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-38194c37-665b-4f53-aa08-d8e96417a3a9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:11.137741 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-38194c37-665b-4f53-aa08-d8e96417a3a9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:11.138173 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-38194c37-665b-4f53-aa08-d8e96417a3a9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:11.271552 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-38194c37-665b-4f53-aa08-d8e96417a3a9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:11.279417 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-38194c37-665b-4f53-aa08-d8e96417a3a9 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.153314 Jun 15 15:52:11.280074 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 157/309] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:11 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:11.679575 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-34eb08f5-32c3-46cf-a42a-9bb4787f7a74 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:11.680181 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-34eb08f5-32c3-46cf-a42a-9bb4787f7a74 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:11.683897 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d6738fc2-c0d0-416e-9a2c-ba18f2fef5db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:11.684502 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d6738fc2-c0d0-416e-9a2c-ba18f2fef5db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:11.687297 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-34eb08f5-32c3-46cf-a42a-9bb4787f7a74 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:11.688280 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-34eb08f5-32c3-46cf-a42a-9bb4787f7a74 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:11.689092 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-34eb08f5-32c3-46cf-a42a-9bb4787f7a74 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:11.689529 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-34eb08f5-32c3-46cf-a42a-9bb4787f7a74 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:11.691528 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d6738fc2-c0d0-416e-9a2c-ba18f2fef5db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:11.692049 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d6738fc2-c0d0-416e-9a2c-ba18f2fef5db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:11.694692 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d6738fc2-c0d0-416e-9a2c-ba18f2fef5db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:11.694692 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d6738fc2-c0d0-416e-9a2c-ba18f2fef5db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:11.974819 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d6738fc2-c0d0-416e-9a2c-ba18f2fef5db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:11.983086 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d6738fc2-c0d0-416e-9a2c-ba18f2fef5db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.303018 Jun 15 15:52:11.983656 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 158/310] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:11 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:12.005857 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-08285dfc-2a31-49ba-9c67-ecfdc8a25116 req-58367380-6788-457e-8226-4689745e6f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3072d511-e603-4222-9e8e-69370d441b30", "name": "network-vif-plugged", "status": "completed", "tag": "cb323fdc-7e88-452a-bf55-5b8f63d4e576"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:52:12.012486 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-34eb08f5-32c3-46cf-a42a-9bb4787f7a74 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:12.020391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-08285dfc-2a31-49ba-9c67-ecfdc8a25116 req-58367380-6788-457e-8226-4689745e6f49 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:12.021181 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-08285dfc-2a31-49ba-9c67-ecfdc8a25116 req-58367380-6788-457e-8226-4689745e6f49 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:12.022971 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-34eb08f5-32c3-46cf-a42a-9bb4787f7a74 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.346768 Jun 15 15:52:12.024128 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 153/311] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:11 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:12.044773 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-08285dfc-2a31-49ba-9c67-ecfdc8a25116 req-58367380-6788-457e-8226-4689745e6f49 service nova] Creating event network-vif-plugged:cb323fdc-7e88-452a-bf55-5b8f63d4e576 for instance 3072d511-e603-4222-9e8e-69370d441b30 on hv-cinder-84599 Jun 15 15:52:12.050550 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-08285dfc-2a31-49ba-9c67-ecfdc8a25116 req-58367380-6788-457e-8226-4689745e6f49 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065775 Jun 15 15:52:12.051158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 159/312] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:52:12.298526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-afe17d09-27cc-4720-8265-934967df5602 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:12.299167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-afe17d09-27cc-4720-8265-934967df5602 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:12.305168 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-afe17d09-27cc-4720-8265-934967df5602 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:12.305620 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-afe17d09-27cc-4720-8265-934967df5602 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:12.306441 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-afe17d09-27cc-4720-8265-934967df5602 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:12.306911 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-afe17d09-27cc-4720-8265-934967df5602 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:12.432433 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-afe17d09-27cc-4720-8265-934967df5602 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:12.439940 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-afe17d09-27cc-4720-8265-934967df5602 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.146030 Jun 15 15:52:12.440509 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 154/313] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:12 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:13.001276 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ed67a69d-63b8-47c8-b9de-f9d5226d3524 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:13.002011 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ed67a69d-63b8-47c8-b9de-f9d5226d3524 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:13.008195 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ed67a69d-63b8-47c8-b9de-f9d5226d3524 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:13.008643 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ed67a69d-63b8-47c8-b9de-f9d5226d3524 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:13.009400 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ed67a69d-63b8-47c8-b9de-f9d5226d3524 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:13.009834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ed67a69d-63b8-47c8-b9de-f9d5226d3524 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:13.040108 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-cc5141f6-aeb6-4616-81c7-d56bf2326c3d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:13.040722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-cc5141f6-aeb6-4616-81c7-d56bf2326c3d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:13.047183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cc5141f6-aeb6-4616-81c7-d56bf2326c3d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:13.047635 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cc5141f6-aeb6-4616-81c7-d56bf2326c3d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:13.048404 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cc5141f6-aeb6-4616-81c7-d56bf2326c3d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:13.048840 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cc5141f6-aeb6-4616-81c7-d56bf2326c3d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:13.427305 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ed67a69d-63b8-47c8-b9de-f9d5226d3524 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:13.435273 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ed67a69d-63b8-47c8-b9de-f9d5226d3524 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.438730 Jun 15 15:52:13.436320 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 160/314] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:12 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:13.456694 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-085cd5bf-de6e-43df-9547-9447bd7e64f8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:13.457450 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-085cd5bf-de6e-43df-9547-9447bd7e64f8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:13.457969 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-cc5141f6-aeb6-4616-81c7-d56bf2326c3d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:13.463523 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-085cd5bf-de6e-43df-9547-9447bd7e64f8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:13.463876 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-085cd5bf-de6e-43df-9547-9447bd7e64f8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:13.464638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-085cd5bf-de6e-43df-9547-9447bd7e64f8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:13.465067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-085cd5bf-de6e-43df-9547-9447bd7e64f8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:13.465420 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-cc5141f6-aeb6-4616-81c7-d56bf2326c3d tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.429364 Jun 15 15:52:13.465972 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 155/315] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:13 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:13.601021 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-085cd5bf-de6e-43df-9547-9447bd7e64f8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:13.608847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-085cd5bf-de6e-43df-9547-9447bd7e64f8 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.155987 Jun 15 15:52:13.609404 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 161/316] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:13 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:14.452716 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-da36d304-db51-41e7-a196-c1edbe0a7431 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:14.453121 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-da36d304-db51-41e7-a196-c1edbe0a7431 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:14.460001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-da36d304-db51-41e7-a196-c1edbe0a7431 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:14.460448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-da36d304-db51-41e7-a196-c1edbe0a7431 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:14.461252 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-da36d304-db51-41e7-a196-c1edbe0a7431 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:14.461686 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-da36d304-db51-41e7-a196-c1edbe0a7431 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:14.481673 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-037f5e24-e12b-4f3a-a1f7-5c86bfcdf188 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:14.482282 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-037f5e24-e12b-4f3a-a1f7-5c86bfcdf188 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:14.488581 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-037f5e24-e12b-4f3a-a1f7-5c86bfcdf188 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:14.489030 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-037f5e24-e12b-4f3a-a1f7-5c86bfcdf188 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:14.489800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-037f5e24-e12b-4f3a-a1f7-5c86bfcdf188 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:14.490235 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-037f5e24-e12b-4f3a-a1f7-5c86bfcdf188 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:14.671476 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-da36d304-db51-41e7-a196-c1edbe0a7431 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:14.676943 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-037f5e24-e12b-4f3a-a1f7-5c86bfcdf188 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:14.681003 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-da36d304-db51-41e7-a196-c1edbe0a7431 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.232353 Jun 15 15:52:14.681569 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 156/317] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:14 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:14.685982 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ec44cb81-7616-4263-b5cf-9160542b731d tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:14.686889 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ec44cb81-7616-4263-b5cf-9160542b731d tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:14.689992 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-037f5e24-e12b-4f3a-a1f7-5c86bfcdf188 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.212175 Jun 15 15:52:14.690629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 162/318] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:14 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:14.695385 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ec44cb81-7616-4263-b5cf-9160542b731d tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:14.695898 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ec44cb81-7616-4263-b5cf-9160542b731d tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:14.696858 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ec44cb81-7616-4263-b5cf-9160542b731d tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:14.698083 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ec44cb81-7616-4263-b5cf-9160542b731d tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:14.875815 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ec44cb81-7616-4263-b5cf-9160542b731d tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:14.884046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ec44cb81-7616-4263-b5cf-9160542b731d tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.201515 Jun 15 15:52:14.884629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 157/319] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:14 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:15.698086 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7dba0f0d-2b8e-4663-8304-405cc289a8b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:15.698678 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7dba0f0d-2b8e-4663-8304-405cc289a8b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:15.704871 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7dba0f0d-2b8e-4663-8304-405cc289a8b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:15.705248 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7dba0f0d-2b8e-4663-8304-405cc289a8b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:15.706087 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7dba0f0d-2b8e-4663-8304-405cc289a8b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:15.706508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7dba0f0d-2b8e-4663-8304-405cc289a8b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:15.706845 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-61978913-43c0-49a0-8b12-9aba954a5c28 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:15.707450 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-61978913-43c0-49a0-8b12-9aba954a5c28 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:15.713995 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61978913-43c0-49a0-8b12-9aba954a5c28 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:15.714436 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61978913-43c0-49a0-8b12-9aba954a5c28 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:15.715218 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61978913-43c0-49a0-8b12-9aba954a5c28 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:15.715652 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61978913-43c0-49a0-8b12-9aba954a5c28 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:15.899744 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7dba0f0d-2b8e-4663-8304-405cc289a8b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:15.903867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-61978913-43c0-49a0-8b12-9aba954a5c28 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:15.907362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7dba0f0d-2b8e-4663-8304-405cc289a8b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.213174 Jun 15 15:52:15.907922 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 163/320] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:15 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:15.911605 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-61978913-43c0-49a0-8b12-9aba954a5c28 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.208591 Jun 15 15:52:15.912568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 158/321] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:15 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:15.912802 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ab6a7a84-f65e-4719-a3d5-6c96368535dc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:15.913462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ab6a7a84-f65e-4719-a3d5-6c96368535dc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:15.919534 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab6a7a84-f65e-4719-a3d5-6c96368535dc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:15.919960 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab6a7a84-f65e-4719-a3d5-6c96368535dc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:15.920705 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab6a7a84-f65e-4719-a3d5-6c96368535dc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:15.921128 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab6a7a84-f65e-4719-a3d5-6c96368535dc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:16.045486 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ab6a7a84-f65e-4719-a3d5-6c96368535dc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:16.053414 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ab6a7a84-f65e-4719-a3d5-6c96368535dc tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.144576 Jun 15 15:52:16.053970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 164/322] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:15 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:16.923862 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1d75d61e-4311-43dc-90f1-b11c333b25cb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:16.924466 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1d75d61e-4311-43dc-90f1-b11c333b25cb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:16.928551 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3e0de707-8f8a-480e-ba71-d28f3f4ad552 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:16.929162 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3e0de707-8f8a-480e-ba71-d28f3f4ad552 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:16.931036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d75d61e-4311-43dc-90f1-b11c333b25cb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:16.931485 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d75d61e-4311-43dc-90f1-b11c333b25cb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:16.932256 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d75d61e-4311-43dc-90f1-b11c333b25cb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:16.932688 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d75d61e-4311-43dc-90f1-b11c333b25cb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:16.935116 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3e0de707-8f8a-480e-ba71-d28f3f4ad552 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:16.935561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3e0de707-8f8a-480e-ba71-d28f3f4ad552 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:16.938146 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3e0de707-8f8a-480e-ba71-d28f3f4ad552 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:16.938146 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3e0de707-8f8a-480e-ba71-d28f3f4ad552 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:17.123690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1d75d61e-4311-43dc-90f1-b11c333b25cb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:17.127651 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=100 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:52:17.127825 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3e0de707-8f8a-480e-ba71-d28f3f4ad552 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:17.133113 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1d75d61e-4311-43dc-90f1-b11c333b25cb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.213149 Jun 15 15:52:17.133885 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 159/323] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:16 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:17.135364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3e0de707-8f8a-480e-ba71-d28f3f4ad552 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.210659 Jun 15 15:52:17.135915 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 165/324] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:16 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:17.138361 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-641f6d0e-9bb8-4ac6-b76a-f133ad6fd15e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:17.138991 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-641f6d0e-9bb8-4ac6-b76a-f133ad6fd15e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:17.145608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-641f6d0e-9bb8-4ac6-b76a-f133ad6fd15e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:17.146067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-641f6d0e-9bb8-4ac6-b76a-f133ad6fd15e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:17.146873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-641f6d0e-9bb8-4ac6-b76a-f133ad6fd15e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:17.147295 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-641f6d0e-9bb8-4ac6-b76a-f133ad6fd15e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:17.298683 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-641f6d0e-9bb8-4ac6-b76a-f133ad6fd15e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:17.306116 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-641f6d0e-9bb8-4ac6-b76a-f133ad6fd15e tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.171293 Jun 15 15:52:17.306670 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 160/325] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:17 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:18.151151 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-420c2a7d-3e47-430a-9ea8-4f47021c3de6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:18.151790 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-420c2a7d-3e47-430a-9ea8-4f47021c3de6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:18.152407 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ef9d3a88-50ea-48dd-a6bc-6f074a99a445 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:18.153002 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ef9d3a88-50ea-48dd-a6bc-6f074a99a445 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:18.158465 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-420c2a7d-3e47-430a-9ea8-4f47021c3de6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:18.158938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-420c2a7d-3e47-430a-9ea8-4f47021c3de6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:18.159697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-420c2a7d-3e47-430a-9ea8-4f47021c3de6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:18.159940 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ef9d3a88-50ea-48dd-a6bc-6f074a99a445 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:18.160124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-420c2a7d-3e47-430a-9ea8-4f47021c3de6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:18.160384 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ef9d3a88-50ea-48dd-a6bc-6f074a99a445 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:18.161136 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ef9d3a88-50ea-48dd-a6bc-6f074a99a445 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:18.161562 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ef9d3a88-50ea-48dd-a6bc-6f074a99a445 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:18.175105 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:52:18.353820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ef9d3a88-50ea-48dd-a6bc-6f074a99a445 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:18.357673 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-420c2a7d-3e47-430a-9ea8-4f47021c3de6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:18.361482 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ef9d3a88-50ea-48dd-a6bc-6f074a99a445 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.212844 Jun 15 15:52:18.362047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 161/326] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:18 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:18.366417 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-943cae95-f3a9-4dee-b7c0-fbb6f9d6d6fe tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:18.367035 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-943cae95-f3a9-4dee-b7c0-fbb6f9d6d6fe tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:18.367423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-420c2a7d-3e47-430a-9ea8-4f47021c3de6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.220065 Jun 15 15:52:18.368161 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 166/327] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:18 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:18.372624 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-943cae95-f3a9-4dee-b7c0-fbb6f9d6d6fe tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:18.373066 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-943cae95-f3a9-4dee-b7c0-fbb6f9d6d6fe tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:18.373809 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-943cae95-f3a9-4dee-b7c0-fbb6f9d6d6fe tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:18.374233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-943cae95-f3a9-4dee-b7c0-fbb6f9d6d6fe tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:18.502276 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-943cae95-f3a9-4dee-b7c0-fbb6f9d6d6fe tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:18.509593 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-943cae95-f3a9-4dee-b7c0-fbb6f9d6d6fe tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.146615 Jun 15 15:52:18.510144 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 162/328] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:18 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:19.377303 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9550760f-e0cd-4a39-b709-be178115a44c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:19.377912 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9550760f-e0cd-4a39-b709-be178115a44c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:19.384036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9550760f-e0cd-4a39-b709-be178115a44c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:19.384187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-483401a1-d7ec-4025-8885-d2fa8abc327f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:19.384589 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9550760f-e0cd-4a39-b709-be178115a44c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:19.384692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-483401a1-d7ec-4025-8885-d2fa8abc327f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:19.385220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9550760f-e0cd-4a39-b709-be178115a44c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:19.385650 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9550760f-e0cd-4a39-b709-be178115a44c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:19.391686 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-483401a1-d7ec-4025-8885-d2fa8abc327f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:19.392137 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-483401a1-d7ec-4025-8885-d2fa8abc327f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:19.392994 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-483401a1-d7ec-4025-8885-d2fa8abc327f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:19.393440 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-483401a1-d7ec-4025-8885-d2fa8abc327f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:19.580658 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-9550760f-e0cd-4a39-b709-be178115a44c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:19.589443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9550760f-e0cd-4a39-b709-be178115a44c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.215842 Jun 15 15:52:19.590296 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 167/329] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:19 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:19.592501 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-483401a1-d7ec-4025-8885-d2fa8abc327f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:19.595298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-60764600-1100-443b-8c90-0bd8b33fb2c3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:19.595893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-60764600-1100-443b-8c90-0bd8b33fb2c3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:19.600888 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-483401a1-d7ec-4025-8885-d2fa8abc327f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.220560 Jun 15 15:52:19.601449 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 163/330] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:19 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:19.602004 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-60764600-1100-443b-8c90-0bd8b33fb2c3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:19.602449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-60764600-1100-443b-8c90-0bd8b33fb2c3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:19.603243 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-60764600-1100-443b-8c90-0bd8b33fb2c3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:19.603669 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-60764600-1100-443b-8c90-0bd8b33fb2c3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:19.733731 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-60764600-1100-443b-8c90-0bd8b33fb2c3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:19.742541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-60764600-1100-443b-8c90-0bd8b33fb2c3 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1470 microversion: 2.1 time: 0.151376 Jun 15 15:52:19.752832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 168/331] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:19 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:20.606922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-25539383-5056-409f-a0f0-1b4159a2830f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:20.607676 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-25539383-5056-409f-a0f0-1b4159a2830f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:20.615603 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-25539383-5056-409f-a0f0-1b4159a2830f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:20.616495 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-25539383-5056-409f-a0f0-1b4159a2830f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:20.616844 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-222b0fa1-ec5c-4bd3-ab79-fc101b81c7b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:20.617468 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-222b0fa1-ec5c-4bd3-ab79-fc101b81c7b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:20.618273 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-25539383-5056-409f-a0f0-1b4159a2830f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:20.619564 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-25539383-5056-409f-a0f0-1b4159a2830f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:20.629228 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-222b0fa1-ec5c-4bd3-ab79-fc101b81c7b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:20.630592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-222b0fa1-ec5c-4bd3-ab79-fc101b81c7b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:20.631752 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-222b0fa1-ec5c-4bd3-ab79-fc101b81c7b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:20.632453 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-222b0fa1-ec5c-4bd3-ab79-fc101b81c7b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:20.841651 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-222b0fa1-ec5c-4bd3-ab79-fc101b81c7b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:20.851150 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-222b0fa1-ec5c-4bd3-ab79-fc101b81c7b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.237966 Jun 15 15:52:20.853462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 169/332] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:20 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:20.856811 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-d9a75f63-aa8c-4960-9ba3-c822d8b0c02d req-7d8a7bb3-ffc5-4525-8577-4fe391ded4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd3fc6c-1f7c-4460-9d14-374fb27cd077", "name": "network-vif-deleted", "tag": "66583eec-a8aa-4d4f-9126-61ff9dca3d25"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:52:20.865995 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-d9a75f63-aa8c-4960-9ba3-c822d8b0c02d req-7d8a7bb3-ffc5-4525-8577-4fe391ded4cb service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:20.866440 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-d9a75f63-aa8c-4960-9ba3-c822d8b0c02d req-7d8a7bb3-ffc5-4525-8577-4fe391ded4cb service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:20.869127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-25539383-5056-409f-a0f0-1b4159a2830f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:20.878305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-25539383-5056-409f-a0f0-1b4159a2830f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.275322 Jun 15 15:52:20.878910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 164/333] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:20 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:20.879039 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-d9a75f63-aa8c-4960-9ba3-c822d8b0c02d req-7d8a7bb3-ffc5-4525-8577-4fe391ded4cb service nova] Creating event network-vif-deleted:66583eec-a8aa-4d4f-9126-61ff9dca3d25 for instance dfd3fc6c-1f7c-4460-9d14-374fb27cd077 on hv-cinder-84599 Jun 15 15:52:20.883389 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-45444163-2f74-48b5-8225-50c0eb18be30 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:20.883986 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-45444163-2f74-48b5-8225-50c0eb18be30 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:20.884187 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-d9a75f63-aa8c-4960-9ba3-c822d8b0c02d req-7d8a7bb3-ffc5-4525-8577-4fe391ded4cb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031180 Jun 15 15:52:20.884959 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 170/334] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:52:20.894338 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-45444163-2f74-48b5-8225-50c0eb18be30 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:20.895173 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-45444163-2f74-48b5-8225-50c0eb18be30 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:20.896253 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-45444163-2f74-48b5-8225-50c0eb18be30 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:20.896777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-45444163-2f74-48b5-8225-50c0eb18be30 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:20.966015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-45444163-2f74-48b5-8225-50c0eb18be30 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:20.974046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-45444163-2f74-48b5-8225-50c0eb18be30 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1300 microversion: 2.1 time: 0.094199 Jun 15 15:52:20.974610 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 165/335] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:20 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:21.869460 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8ba7a009-c33b-4c46-a9be-a7b3c79d1406 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:21.870149 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8ba7a009-c33b-4c46-a9be-a7b3c79d1406 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:21.877017 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8ba7a009-c33b-4c46-a9be-a7b3c79d1406 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:21.877456 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8ba7a009-c33b-4c46-a9be-a7b3c79d1406 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:21.878213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8ba7a009-c33b-4c46-a9be-a7b3c79d1406 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:21.878642 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8ba7a009-c33b-4c46-a9be-a7b3c79d1406 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:21.895329 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5ba1dcd9-9794-45b6-b440-dc9b24b6141b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:21.895931 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5ba1dcd9-9794-45b6-b440-dc9b24b6141b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:21.902309 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ba1dcd9-9794-45b6-b440-dc9b24b6141b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:21.902783 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ba1dcd9-9794-45b6-b440-dc9b24b6141b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:21.903546 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ba1dcd9-9794-45b6-b440-dc9b24b6141b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:21.903972 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ba1dcd9-9794-45b6-b440-dc9b24b6141b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:22.078532 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8ba7a009-c33b-4c46-a9be-a7b3c79d1406 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:22.082923 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5ba1dcd9-9794-45b6-b440-dc9b24b6141b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:22.086298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8ba7a009-c33b-4c46-a9be-a7b3c79d1406 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1322 microversion: 2.1 time: 0.221147 Jun 15 15:52:22.086893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 171/336] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:21 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:22.090598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5ba1dcd9-9794-45b6-b440-dc9b24b6141b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.199329 Jun 15 15:52:22.091463 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-84334840-667c-4d93-8481-d6c9cd9ad46a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:22.092063 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-84334840-667c-4d93-8481-d6c9cd9ad46a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:22.099377 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84334840-667c-4d93-8481-d6c9cd9ad46a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:22.099819 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84334840-667c-4d93-8481-d6c9cd9ad46a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:22.100582 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84334840-667c-4d93-8481-d6c9cd9ad46a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:22.100690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 166/337] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:21 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:22.101015 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84334840-667c-4d93-8481-d6c9cd9ad46a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:22.131463 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84334840-667c-4d93-8481-d6c9cd9ad46a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:22.131910 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84334840-667c-4d93-8481-d6c9cd9ad46a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:22.132355 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-84334840-667c-4d93-8481-d6c9cd9ad46a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lazy-loading 'fault' on Instance uuid dfd3fc6c-1f7c-4460-9d14-374fb27cd077 {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:52:22.175513 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-84334840-667c-4d93-8481-d6c9cd9ad46a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d74c0a687664ac78d3c413251033e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '718238a5852e4d9a93d85fa8fcf41643', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:22.183774 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-84334840-667c-4d93-8481-d6c9cd9ad46a tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 200 len: 1305 microversion: 2.1 time: 0.095728 Jun 15 15:52:22.184545 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 172/338] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:22 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:22.279457 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-91f1e297-ec9d-4b82-b934-129f66f62cc7 req-59b15daa-63aa-48f7-be5b-acb80a762b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd894d3e-d369-42df-80c8-fb5ae7ed03ea", "name": "network-vif-plugged", "status": "completed", "tag": "fb40b76c-ac84-484b-9777-63cbb798edb4"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:52:22.288829 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-91f1e297-ec9d-4b82-b934-129f66f62cc7 req-59b15daa-63aa-48f7-be5b-acb80a762b35 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:22.289272 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-91f1e297-ec9d-4b82-b934-129f66f62cc7 req-59b15daa-63aa-48f7-be5b-acb80a762b35 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:22.303057 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-91f1e297-ec9d-4b82-b934-129f66f62cc7 req-59b15daa-63aa-48f7-be5b-acb80a762b35 service nova] Creating event network-vif-plugged:fb40b76c-ac84-484b-9777-63cbb798edb4 for instance cd894d3e-d369-42df-80c8-fb5ae7ed03ea on hv-cinder-84599 Jun 15 15:52:22.308717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-91f1e297-ec9d-4b82-b934-129f66f62cc7 req-59b15daa-63aa-48f7-be5b-acb80a762b35 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033027 Jun 15 15:52:22.309301 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 167/339] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:52:23.103456 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-95747cd6-8dbc-4f00-b483-4b56b040ce05 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:23.104214 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-95747cd6-8dbc-4f00-b483-4b56b040ce05 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:23.107227 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:52:23.109024 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-39818cf3-0188-404d-948b-ac61ad45379f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:23.111090 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-39818cf3-0188-404d-948b-ac61ad45379f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:23.113156 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=80 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:52:23.115459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95747cd6-8dbc-4f00-b483-4b56b040ce05 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:23.115912 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95747cd6-8dbc-4f00-b483-4b56b040ce05 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:23.117088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95747cd6-8dbc-4f00-b483-4b56b040ce05 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:23.117648 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95747cd6-8dbc-4f00-b483-4b56b040ce05 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:23.126168 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-39818cf3-0188-404d-948b-ac61ad45379f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:23.126439 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-39818cf3-0188-404d-948b-ac61ad45379f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:23.131036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-39818cf3-0188-404d-948b-ac61ad45379f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:23.131487 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-39818cf3-0188-404d-948b-ac61ad45379f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:23.340572 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-95747cd6-8dbc-4f00-b483-4b56b040ce05 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:23.349044 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-95747cd6-8dbc-4f00-b483-4b56b040ce05 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1517 microversion: 2.1 time: 0.249344 Jun 15 15:52:23.349565 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-39818cf3-0188-404d-948b-ac61ad45379f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:23.350175 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 173/340] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:23 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1517 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:23.354806 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5bc6e57c-c30e-4666-8ffa-43ec2a36e037 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:23.355794 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5bc6e57c-c30e-4666-8ffa-43ec2a36e037 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] [instance: dfd3fc6c-1f7c-4460-9d14-374fb27cd077] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:23.361929 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-39818cf3-0188-404d-948b-ac61ad45379f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.256355 Jun 15 15:52:23.362542 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 168/341] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:23 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:23.371422 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0549efd6-39d8-4785-a396-a004d20bdabe tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:52:23.371422 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0549efd6-39d8-4785-a396-a004d20bdabe tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:23.373801 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5bc6e57c-c30e-4666-8ffa-43ec2a36e037 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:23.374553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5bc6e57c-c30e-4666-8ffa-43ec2a36e037 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:23.376225 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5bc6e57c-c30e-4666-8ffa-43ec2a36e037 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:23.376986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5bc6e57c-c30e-4666-8ffa-43ec2a36e037 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:23.377227 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0549efd6-39d8-4785-a396-a004d20bdabe tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:23.377657 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0549efd6-39d8-4785-a396-a004d20bdabe tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:23.378485 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0549efd6-39d8-4785-a396-a004d20bdabe tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:23.378866 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0549efd6-39d8-4785-a396-a004d20bdabe tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:23.396532 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-5bc6e57c-c30e-4666-8ffa-43ec2a36e037 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] HTTP exception thrown: Instance dfd3fc6c-1f7c-4460-9d14-374fb27cd077 could not be found. Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5bc6e57c-c30e-4666-8ffa-43ec2a36e037 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Request method failure captured: Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 HTTP/1.1 Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgAEjItXGwlBhWNqNhkEaAFoZxXqP9mttFCvtY5qOtf3inr_YPdJR38_hNcyF6Q19wYk8DGQ-e0G0G2rqGJMsPbqJPQuix7NyH4R04eRriAqkG_q8WkqjeM2OuZaCyCpN6WunZ5XaGfPYvli6WsLddJLZIrEtEKWesCsP9BSxVlAjQs Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 718238a5852e4d9a93d85fa8fcf41643 Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-VolumesNegativeTest-2100952113 Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:52:23.399812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/718238a5852e4d9a93d85fa8fcf41643"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/718238a5852e4d9a93d85fa8fcf41643"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/718238a5852e4d9a93d85fa8fcf41643"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_718238a5852e4d9a93d85fa8fcf41643", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-VolumesNegativeTest-2100952113 Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 718238a5852e4d9a93d85fa8fcf41643 Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-VolumesNegativeTest-2100952113 Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-VolumesNegativeTest-2100952113-project Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 5d74c0a687664ac78d3c413251033e49 Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-VolumesNegativeTest-2100952113-project Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance dfd3fc6c-1f7c-4460-9d14-374fb27cd077 could not be found. Jun 15 15:52:23.401178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': 'dfd3fc6c-1f7c-4460-9d14-374fb27cd077'} Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd3fc6c-1f7c-4460-9d14-374fb27cd077 could not be found. Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:52:23.401970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd3fc6c-1f7c-4460-9d14-374fb27cd077 could not be found. Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd3fc6c-1f7c-4460-9d14-374fb27cd077 could not be found. Jun 15 15:52:23.403836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:52:23.406676 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-0549efd6-39d8-4785-a396-a004d20bdabe tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lazy-loading 'flavor' on Instance uuid 3072d511-e603-4222-9e8e-69370d441b30 {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:52:23.407802 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5bc6e57c-c30e-4666-8ffa-43ec2a36e037 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] Returning 404 to user: Instance dfd3fc6c-1f7c-4460-9d14-374fb27cd077 could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:52:23.408828 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5bc6e57c-c30e-4666-8ffa-43ec2a36e037 tempest-VolumesNegativeTest-2100952113 tempest-VolumesNegativeTest-2100952113-project] 10.222.0.62 "GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077" status: 404 len: 111 microversion: 2.1 time: 0.057519 Jun 15 15:52:23.413265 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 174/342] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:23 2022] GET /compute/v2.1/servers/dfd3fc6c-1f7c-4460-9d14-374fb27cd077 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:52:23.544855 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0549efd6-39d8-4785-a396-a004d20bdabe tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "POST /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30/action" status: 200 len: 32 microversion: 2.1 time: 0.181030 Jun 15 15:52:23.550058 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 169/343] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 15:52:23 2022] POST /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:52:23.556432 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7cfc4974-81e5-4399-9cc3-799facfe6ef1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:23.557327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7cfc4974-81e5-4399-9cc3-799facfe6ef1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:23.563576 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7cfc4974-81e5-4399-9cc3-799facfe6ef1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:23.564197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7cfc4974-81e5-4399-9cc3-799facfe6ef1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:23.564940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7cfc4974-81e5-4399-9cc3-799facfe6ef1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:23.565365 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7cfc4974-81e5-4399-9cc3-799facfe6ef1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:23.713747 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7cfc4974-81e5-4399-9cc3-799facfe6ef1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:23.722101 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7cfc4974-81e5-4399-9cc3-799facfe6ef1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.170519 Jun 15 15:52:23.722662 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 175/344] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:23 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:24.381488 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b49a1ff7-b04e-418e-89c6-a27b24c11ad2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:24.382190 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b49a1ff7-b04e-418e-89c6-a27b24c11ad2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:24.395584 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b49a1ff7-b04e-418e-89c6-a27b24c11ad2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:24.396050 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b49a1ff7-b04e-418e-89c6-a27b24c11ad2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:24.396822 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b49a1ff7-b04e-418e-89c6-a27b24c11ad2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:24.397251 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b49a1ff7-b04e-418e-89c6-a27b24c11ad2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:24.549113 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b49a1ff7-b04e-418e-89c6-a27b24c11ad2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:24.556470 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b49a1ff7-b04e-418e-89c6-a27b24c11ad2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1318 microversion: 2.1 time: 0.181348 Jun 15 15:52:24.557030 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 170/345] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:24 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:24.741697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b06837ea-051d-4bf2-843c-fbfb9c2a74b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:24.742634 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b06837ea-051d-4bf2-843c-fbfb9c2a74b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:24.749395 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b06837ea-051d-4bf2-843c-fbfb9c2a74b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:24.749925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b06837ea-051d-4bf2-843c-fbfb9c2a74b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:24.751408 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b06837ea-051d-4bf2-843c-fbfb9c2a74b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:24.751918 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b06837ea-051d-4bf2-843c-fbfb9c2a74b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:24.916081 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b06837ea-051d-4bf2-843c-fbfb9c2a74b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:24.924204 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b06837ea-051d-4bf2-843c-fbfb9c2a74b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.188248 Jun 15 15:52:24.924762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 176/346] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:24 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:25.574240 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f3b2dedd-6682-4a07-957a-a251e2a17c88 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:25.575017 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f3b2dedd-6682-4a07-957a-a251e2a17c88 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:25.582461 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f3b2dedd-6682-4a07-957a-a251e2a17c88 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:25.583168 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f3b2dedd-6682-4a07-957a-a251e2a17c88 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:25.583883 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f3b2dedd-6682-4a07-957a-a251e2a17c88 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:25.584385 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f3b2dedd-6682-4a07-957a-a251e2a17c88 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:25.739921 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f3b2dedd-6682-4a07-957a-a251e2a17c88 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:25.753142 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f3b2dedd-6682-4a07-957a-a251e2a17c88 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1505 microversion: 2.1 time: 0.183197 Jun 15 15:52:25.753722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 171/347] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:25 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:25.947165 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3f594d16-41e1-4edd-8db5-cb66db47d209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:25.948385 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3f594d16-41e1-4edd-8db5-cb66db47d209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:25.959022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f594d16-41e1-4edd-8db5-cb66db47d209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:25.959022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f594d16-41e1-4edd-8db5-cb66db47d209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:25.959022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f594d16-41e1-4edd-8db5-cb66db47d209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:25.959022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f594d16-41e1-4edd-8db5-cb66db47d209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:26.102145 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3f594d16-41e1-4edd-8db5-cb66db47d209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:26.109751 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3f594d16-41e1-4edd-8db5-cb66db47d209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.168074 Jun 15 15:52:26.111026 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 177/348] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:25 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:27.130495 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-05ed538b-f27e-446d-9428-df6accd71194 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:27.131264 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-05ed538b-f27e-446d-9428-df6accd71194 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:27.137899 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05ed538b-f27e-446d-9428-df6accd71194 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:27.138343 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05ed538b-f27e-446d-9428-df6accd71194 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:27.139135 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05ed538b-f27e-446d-9428-df6accd71194 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:27.139568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05ed538b-f27e-446d-9428-df6accd71194 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:27.280463 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-05ed538b-f27e-446d-9428-df6accd71194 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:27.289403 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-05ed538b-f27e-446d-9428-df6accd71194 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.164066 Jun 15 15:52:27.289979 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 172/349] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:27 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:28.307721 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1c0ae6b3-d182-4a51-8673-673cdd5ce820 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:28.308375 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1c0ae6b3-d182-4a51-8673-673cdd5ce820 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:28.314186 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1c0ae6b3-d182-4a51-8673-673cdd5ce820 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:28.314626 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1c0ae6b3-d182-4a51-8673-673cdd5ce820 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:28.315407 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1c0ae6b3-d182-4a51-8673-673cdd5ce820 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:28.315837 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1c0ae6b3-d182-4a51-8673-673cdd5ce820 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:28.471781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1c0ae6b3-d182-4a51-8673-673cdd5ce820 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:28.480028 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1c0ae6b3-d182-4a51-8673-673cdd5ce820 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.175994 Jun 15 15:52:28.480808 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 178/350] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:28 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:29.496877 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b6fa274c-2b86-4237-bf22-90003d29c696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:29.497524 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b6fa274c-2b86-4237-bf22-90003d29c696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:29.507466 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b6fa274c-2b86-4237-bf22-90003d29c696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:29.508245 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b6fa274c-2b86-4237-bf22-90003d29c696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:29.509094 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b6fa274c-2b86-4237-bf22-90003d29c696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:29.509595 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b6fa274c-2b86-4237-bf22-90003d29c696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:29.645126 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b6fa274c-2b86-4237-bf22-90003d29c696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:29.652540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b6fa274c-2b86-4237-bf22-90003d29c696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.160145 Jun 15 15:52:29.653105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 173/351] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:29 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:30.669928 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-250020f9-b75e-48f0-9b52-d0c071c20356 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:30.670549 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-250020f9-b75e-48f0-9b52-d0c071c20356 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:30.677089 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-250020f9-b75e-48f0-9b52-d0c071c20356 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:30.677524 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-250020f9-b75e-48f0-9b52-d0c071c20356 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:30.678431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-250020f9-b75e-48f0-9b52-d0c071c20356 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:30.679270 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-250020f9-b75e-48f0-9b52-d0c071c20356 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:30.812325 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-250020f9-b75e-48f0-9b52-d0c071c20356 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:30.820589 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-250020f9-b75e-48f0-9b52-d0c071c20356 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.154484 Jun 15 15:52:30.821157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 179/352] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:30 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:31.837059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a2080011-bdcf-4f56-a554-334f5145bd76 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:31.837667 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a2080011-bdcf-4f56-a554-334f5145bd76 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:31.844175 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a2080011-bdcf-4f56-a554-334f5145bd76 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:31.844631 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a2080011-bdcf-4f56-a554-334f5145bd76 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:31.845388 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a2080011-bdcf-4f56-a554-334f5145bd76 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:31.845821 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a2080011-bdcf-4f56-a554-334f5145bd76 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:31.973359 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a2080011-bdcf-4f56-a554-334f5145bd76 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:31.980739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a2080011-bdcf-4f56-a554-334f5145bd76 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.147506 Jun 15 15:52:31.981310 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 174/353] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:31 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:32.997367 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5f6fc2bf-bd20-43cd-97ff-18cd220425d1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:32.997972 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5f6fc2bf-bd20-43cd-97ff-18cd220425d1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:33.004843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5f6fc2bf-bd20-43cd-97ff-18cd220425d1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:33.005286 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5f6fc2bf-bd20-43cd-97ff-18cd220425d1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:33.006048 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5f6fc2bf-bd20-43cd-97ff-18cd220425d1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:33.006476 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5f6fc2bf-bd20-43cd-97ff-18cd220425d1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:33.137099 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5f6fc2bf-bd20-43cd-97ff-18cd220425d1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:33.144558 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5f6fc2bf-bd20-43cd-97ff-18cd220425d1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.151083 Jun 15 15:52:33.145111 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 180/354] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:32 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:34.161523 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f37527cb-352d-415a-aa7a-6e9018b2f430 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:34.162406 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f37527cb-352d-415a-aa7a-6e9018b2f430 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:34.168449 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f37527cb-352d-415a-aa7a-6e9018b2f430 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:34.168890 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f37527cb-352d-415a-aa7a-6e9018b2f430 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:34.169935 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f37527cb-352d-415a-aa7a-6e9018b2f430 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:34.170365 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f37527cb-352d-415a-aa7a-6e9018b2f430 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:34.174862 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:52:34.304313 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f37527cb-352d-415a-aa7a-6e9018b2f430 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:34.311891 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f37527cb-352d-415a-aa7a-6e9018b2f430 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.154394 Jun 15 15:52:34.312460 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 175/355] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:34 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:35.330283 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7b637043-1c8b-4d5f-bfd9-03a3fba87650 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:35.330842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7b637043-1c8b-4d5f-bfd9-03a3fba87650 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:35.336918 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7b637043-1c8b-4d5f-bfd9-03a3fba87650 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:35.337359 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7b637043-1c8b-4d5f-bfd9-03a3fba87650 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:35.338106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7b637043-1c8b-4d5f-bfd9-03a3fba87650 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:35.338535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7b637043-1c8b-4d5f-bfd9-03a3fba87650 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:35.466612 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7b637043-1c8b-4d5f-bfd9-03a3fba87650 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:35.474005 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7b637043-1c8b-4d5f-bfd9-03a3fba87650 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.147718 Jun 15 15:52:35.474560 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 181/356] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:35 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:36.490424 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-37e9a9dc-4d16-40b0-9f72-1ae01771bf13 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:36.491089 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-37e9a9dc-4d16-40b0-9f72-1ae01771bf13 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:36.497582 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37e9a9dc-4d16-40b0-9f72-1ae01771bf13 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:36.498025 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37e9a9dc-4d16-40b0-9f72-1ae01771bf13 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:36.498807 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37e9a9dc-4d16-40b0-9f72-1ae01771bf13 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:36.499239 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37e9a9dc-4d16-40b0-9f72-1ae01771bf13 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:36.630247 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-37e9a9dc-4d16-40b0-9f72-1ae01771bf13 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:36.637864 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-37e9a9dc-4d16-40b0-9f72-1ae01771bf13 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.151224 Jun 15 15:52:36.638432 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 176/357] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:36 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:37.655191 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-48b441a7-0c2a-457d-81b1-516dd9f62d25 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:37.655808 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-48b441a7-0c2a-457d-81b1-516dd9f62d25 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:37.662961 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48b441a7-0c2a-457d-81b1-516dd9f62d25 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:37.663410 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48b441a7-0c2a-457d-81b1-516dd9f62d25 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:37.664180 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48b441a7-0c2a-457d-81b1-516dd9f62d25 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:37.664608 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48b441a7-0c2a-457d-81b1-516dd9f62d25 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:37.791573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-48b441a7-0c2a-457d-81b1-516dd9f62d25 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:37.799002 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-48b441a7-0c2a-457d-81b1-516dd9f62d25 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.147883 Jun 15 15:52:37.799566 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 182/358] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:37 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:38.816147 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-413f1b27-4143-4554-a211-27159b1132fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:38.816747 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-413f1b27-4143-4554-a211-27159b1132fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:38.823451 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-413f1b27-4143-4554-a211-27159b1132fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:38.823901 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-413f1b27-4143-4554-a211-27159b1132fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:38.824667 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-413f1b27-4143-4554-a211-27159b1132fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:38.825125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-413f1b27-4143-4554-a211-27159b1132fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:38.955130 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-413f1b27-4143-4554-a211-27159b1132fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:38.962507 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-413f1b27-4143-4554-a211-27159b1132fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.150738 Jun 15 15:52:38.963093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 177/359] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:38 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:39.978421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f2ad5800-58e8-4d9e-9a84-c6753f1bef73 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:39.979052 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f2ad5800-58e8-4d9e-9a84-c6753f1bef73 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:39.985106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2ad5800-58e8-4d9e-9a84-c6753f1bef73 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:39.985553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2ad5800-58e8-4d9e-9a84-c6753f1bef73 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:39.986309 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2ad5800-58e8-4d9e-9a84-c6753f1bef73 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:39.986756 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2ad5800-58e8-4d9e-9a84-c6753f1bef73 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:40.117248 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f2ad5800-58e8-4d9e-9a84-c6753f1bef73 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:40.124853 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f2ad5800-58e8-4d9e-9a84-c6753f1bef73 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.150327 Jun 15 15:52:40.125405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 183/360] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:39 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:41.141613 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-507ef2fd-6133-4180-93b6-2c7fdc1273f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:41.142238 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-507ef2fd-6133-4180-93b6-2c7fdc1273f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:41.148885 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-507ef2fd-6133-4180-93b6-2c7fdc1273f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:41.149333 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-507ef2fd-6133-4180-93b6-2c7fdc1273f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:41.150090 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-507ef2fd-6133-4180-93b6-2c7fdc1273f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:41.150521 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-507ef2fd-6133-4180-93b6-2c7fdc1273f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:41.285599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-507ef2fd-6133-4180-93b6-2c7fdc1273f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:41.293360 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-507ef2fd-6133-4180-93b6-2c7fdc1273f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.155575 Jun 15 15:52:41.293926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 178/361] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:41 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:42.310692 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-31dacd11-e77a-4051-b54e-7c7a23691293 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:42.311320 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-31dacd11-e77a-4051-b54e-7c7a23691293 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:42.318242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-31dacd11-e77a-4051-b54e-7c7a23691293 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:42.318611 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-31dacd11-e77a-4051-b54e-7c7a23691293 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:42.319409 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-31dacd11-e77a-4051-b54e-7c7a23691293 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:42.319844 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-31dacd11-e77a-4051-b54e-7c7a23691293 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:42.322562 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:52:42.450537 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-31dacd11-e77a-4051-b54e-7c7a23691293 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:42.458724 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-31dacd11-e77a-4051-b54e-7c7a23691293 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.152115 Jun 15 15:52:42.459302 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 184/362] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:42 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:43.476523 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0b9c9c90-1917-464b-b54b-e41ddbd53300 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:43.477128 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0b9c9c90-1917-464b-b54b-e41ddbd53300 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:43.483737 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0b9c9c90-1917-464b-b54b-e41ddbd53300 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:43.484179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0b9c9c90-1917-464b-b54b-e41ddbd53300 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:43.484974 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0b9c9c90-1917-464b-b54b-e41ddbd53300 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:43.485409 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0b9c9c90-1917-464b-b54b-e41ddbd53300 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:43.616449 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0b9c9c90-1917-464b-b54b-e41ddbd53300 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:43.624174 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0b9c9c90-1917-464b-b54b-e41ddbd53300 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.151468 Jun 15 15:52:43.624774 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 179/363] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:43 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:44.641139 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6759a95a-4505-495e-97f4-5efda6c7c489 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:44.641738 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6759a95a-4505-495e-97f4-5efda6c7c489 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:44.647759 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6759a95a-4505-495e-97f4-5efda6c7c489 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:44.648200 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6759a95a-4505-495e-97f4-5efda6c7c489 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:44.648947 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6759a95a-4505-495e-97f4-5efda6c7c489 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:44.649370 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6759a95a-4505-495e-97f4-5efda6c7c489 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:44.777876 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6759a95a-4505-495e-97f4-5efda6c7c489 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:44.785884 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6759a95a-4505-495e-97f4-5efda6c7c489 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.148629 Jun 15 15:52:44.786430 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 185/364] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:44 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:45.802245 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-96cebd16-35a2-40dc-851f-ded981d808fd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:45.802823 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-96cebd16-35a2-40dc-851f-ded981d808fd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:45.809336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96cebd16-35a2-40dc-851f-ded981d808fd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:45.809785 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96cebd16-35a2-40dc-851f-ded981d808fd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:45.810549 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96cebd16-35a2-40dc-851f-ded981d808fd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:45.811014 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96cebd16-35a2-40dc-851f-ded981d808fd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:45.935421 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-96cebd16-35a2-40dc-851f-ded981d808fd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:45.943371 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-96cebd16-35a2-40dc-851f-ded981d808fd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.145095 Jun 15 15:52:45.943932 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 180/365] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:45 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:46.960010 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b4ecff89-a4ca-4e36-a5b8-af6fcbdec2ba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:46.960609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b4ecff89-a4ca-4e36-a5b8-af6fcbdec2ba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:46.966571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b4ecff89-a4ca-4e36-a5b8-af6fcbdec2ba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:46.967051 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b4ecff89-a4ca-4e36-a5b8-af6fcbdec2ba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:46.967805 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b4ecff89-a4ca-4e36-a5b8-af6fcbdec2ba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:46.968243 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b4ecff89-a4ca-4e36-a5b8-af6fcbdec2ba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:47.099490 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b4ecff89-a4ca-4e36-a5b8-af6fcbdec2ba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:47.106897 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b4ecff89-a4ca-4e36-a5b8-af6fcbdec2ba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.150790 Jun 15 15:52:47.107454 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 186/366] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:46 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:48.123382 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-dad6b08a-b06a-4c10-8353-bc87177d3767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:48.123989 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-dad6b08a-b06a-4c10-8353-bc87177d3767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:48.131108 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dad6b08a-b06a-4c10-8353-bc87177d3767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:48.131554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dad6b08a-b06a-4c10-8353-bc87177d3767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:48.132309 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dad6b08a-b06a-4c10-8353-bc87177d3767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:48.132737 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dad6b08a-b06a-4c10-8353-bc87177d3767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:48.258361 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-dad6b08a-b06a-4c10-8353-bc87177d3767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:48.265842 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-dad6b08a-b06a-4c10-8353-bc87177d3767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.146340 Jun 15 15:52:48.266405 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 181/367] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:48 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:49.282630 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-06eebc43-f616-4978-a39e-ead5f3d034cd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:49.283558 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-06eebc43-f616-4978-a39e-ead5f3d034cd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:49.289841 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-06eebc43-f616-4978-a39e-ead5f3d034cd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:49.290281 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-06eebc43-f616-4978-a39e-ead5f3d034cd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:49.291060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-06eebc43-f616-4978-a39e-ead5f3d034cd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:49.291491 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-06eebc43-f616-4978-a39e-ead5f3d034cd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:49.417444 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-06eebc43-f616-4978-a39e-ead5f3d034cd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:49.425332 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-06eebc43-f616-4978-a39e-ead5f3d034cd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.146881 Jun 15 15:52:49.425892 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 187/368] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:49 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:50.441796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-51dfad32-0c0b-41dc-9819-4c75a609e82d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:50.442405 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-51dfad32-0c0b-41dc-9819-4c75a609e82d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:50.448962 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-51dfad32-0c0b-41dc-9819-4c75a609e82d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:50.449416 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-51dfad32-0c0b-41dc-9819-4c75a609e82d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:50.450186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-51dfad32-0c0b-41dc-9819-4c75a609e82d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:50.450620 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-51dfad32-0c0b-41dc-9819-4c75a609e82d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:50.581240 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-51dfad32-0c0b-41dc-9819-4c75a609e82d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:50.588800 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-51dfad32-0c0b-41dc-9819-4c75a609e82d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.151307 Jun 15 15:52:50.589778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 182/369] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:50 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:51.605474 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-073c8f06-8f8c-48fe-8c53-dbb2b2f8c3fb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:51.606077 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-073c8f06-8f8c-48fe-8c53-dbb2b2f8c3fb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:51.616169 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-073c8f06-8f8c-48fe-8c53-dbb2b2f8c3fb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:51.616623 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-073c8f06-8f8c-48fe-8c53-dbb2b2f8c3fb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:51.617393 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-073c8f06-8f8c-48fe-8c53-dbb2b2f8c3fb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:51.617827 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-073c8f06-8f8c-48fe-8c53-dbb2b2f8c3fb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:51.749866 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-073c8f06-8f8c-48fe-8c53-dbb2b2f8c3fb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:51.757466 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-073c8f06-8f8c-48fe-8c53-dbb2b2f8c3fb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.155765 Jun 15 15:52:51.758448 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 188/370] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:51 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:52.776439 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2d291be1-b3da-42ea-9d8d-cbb858f7a050 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:52.776980 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2d291be1-b3da-42ea-9d8d-cbb858f7a050 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:52.783553 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2d291be1-b3da-42ea-9d8d-cbb858f7a050 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:52.784006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2d291be1-b3da-42ea-9d8d-cbb858f7a050 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:52.784772 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2d291be1-b3da-42ea-9d8d-cbb858f7a050 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:52.785210 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2d291be1-b3da-42ea-9d8d-cbb858f7a050 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:52.915481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2d291be1-b3da-42ea-9d8d-cbb858f7a050 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:52.923285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2d291be1-b3da-42ea-9d8d-cbb858f7a050 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.150479 Jun 15 15:52:52.924361 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 183/371] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:52 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:53.941313 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-20a278dc-c4d8-41d4-a5fd-a9e4b193ae33 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:53.941916 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-20a278dc-c4d8-41d4-a5fd-a9e4b193ae33 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:53.943921 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=32 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:52:53.949208 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20a278dc-c4d8-41d4-a5fd-a9e4b193ae33 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:53.949652 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20a278dc-c4d8-41d4-a5fd-a9e4b193ae33 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:53.950404 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20a278dc-c4d8-41d4-a5fd-a9e4b193ae33 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:53.950859 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20a278dc-c4d8-41d4-a5fd-a9e4b193ae33 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:54.074260 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-20a278dc-c4d8-41d4-a5fd-a9e4b193ae33 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:54.082198 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-20a278dc-c4d8-41d4-a5fd-a9e4b193ae33 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.145313 Jun 15 15:52:54.082771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 189/372] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:53 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:55.099431 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-25147a07-7171-4dca-b7f9-c6770cce060a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:55.100176 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-25147a07-7171-4dca-b7f9-c6770cce060a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:55.102696 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=32 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:52:55.108022 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-25147a07-7171-4dca-b7f9-c6770cce060a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:55.108477 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-25147a07-7171-4dca-b7f9-c6770cce060a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:55.109253 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-25147a07-7171-4dca-b7f9-c6770cce060a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:55.109693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-25147a07-7171-4dca-b7f9-c6770cce060a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:55.246707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-25147a07-7171-4dca-b7f9-c6770cce060a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:55.254624 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-25147a07-7171-4dca-b7f9-c6770cce060a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.159891 Jun 15 15:52:55.255228 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 184/373] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:55 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:56.271314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-22988a04-5dbc-47ff-bd49-a3f96718950e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:56.271936 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-22988a04-5dbc-47ff-bd49-a3f96718950e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:56.277909 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-22988a04-5dbc-47ff-bd49-a3f96718950e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:56.278355 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-22988a04-5dbc-47ff-bd49-a3f96718950e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:56.279157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-22988a04-5dbc-47ff-bd49-a3f96718950e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:56.279590 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-22988a04-5dbc-47ff-bd49-a3f96718950e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:56.403587 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-22988a04-5dbc-47ff-bd49-a3f96718950e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:56.410956 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-22988a04-5dbc-47ff-bd49-a3f96718950e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.143454 Jun 15 15:52:56.411513 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 190/374] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:56 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:57.427608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-26c7966f-67de-4fbe-96a6-ca957159f63c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:57.428235 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-26c7966f-67de-4fbe-96a6-ca957159f63c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:57.434706 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-26c7966f-67de-4fbe-96a6-ca957159f63c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:57.435176 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-26c7966f-67de-4fbe-96a6-ca957159f63c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:57.435936 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-26c7966f-67de-4fbe-96a6-ca957159f63c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:57.436359 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-26c7966f-67de-4fbe-96a6-ca957159f63c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:57.567040 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-26c7966f-67de-4fbe-96a6-ca957159f63c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:57.574419 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-26c7966f-67de-4fbe-96a6-ca957159f63c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.150661 Jun 15 15:52:57.575010 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 185/375] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:57 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:52:58.590527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-00b56a06-5f36-4e5a-9848-cb658eeba592 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:58.591164 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-00b56a06-5f36-4e5a-9848-cb658eeba592 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:58.597158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00b56a06-5f36-4e5a-9848-cb658eeba592 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:58.597598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00b56a06-5f36-4e5a-9848-cb658eeba592 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:58.598356 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00b56a06-5f36-4e5a-9848-cb658eeba592 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:58.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00b56a06-5f36-4e5a-9848-cb658eeba592 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:58.733417 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-00b56a06-5f36-4e5a-9848-cb658eeba592 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:58.740812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-00b56a06-5f36-4e5a-9848-cb658eeba592 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.154146 Jun 15 15:52:58.741382 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 191/376] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:58 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:52:59.757530 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-da60505b-f6b7-4c64-94b6-c384b1125481 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:52:59.758451 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-da60505b-f6b7-4c64-94b6-c384b1125481 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:52:59.764968 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-da60505b-f6b7-4c64-94b6-c384b1125481 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:59.765416 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-da60505b-f6b7-4c64-94b6-c384b1125481 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:59.767344 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-da60505b-f6b7-4c64-94b6-c384b1125481 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:52:59.767785 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-da60505b-f6b7-4c64-94b6-c384b1125481 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:52:59.897980 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-da60505b-f6b7-4c64-94b6-c384b1125481 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:52:59.905693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-da60505b-f6b7-4c64-94b6-c384b1125481 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.152187 Jun 15 15:52:59.906463 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 186/377] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:52:59 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:00.923219 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a91320db-f84b-424f-8d01-eccf0787eb5f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:00.923823 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a91320db-f84b-424f-8d01-eccf0787eb5f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:00.930483 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a91320db-f84b-424f-8d01-eccf0787eb5f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:00.931267 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a91320db-f84b-424f-8d01-eccf0787eb5f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:00.932028 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a91320db-f84b-424f-8d01-eccf0787eb5f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:00.932467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a91320db-f84b-424f-8d01-eccf0787eb5f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:01.062446 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a91320db-f84b-424f-8d01-eccf0787eb5f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:01.069930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a91320db-f84b-424f-8d01-eccf0787eb5f tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.150599 Jun 15 15:53:01.070485 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 192/378] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:00 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:02.085803 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5ba7a5bf-e1c2-4ce1-9c0b-223962ca76bb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:02.086405 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5ba7a5bf-e1c2-4ce1-9c0b-223962ca76bb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:02.092816 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ba7a5bf-e1c2-4ce1-9c0b-223962ca76bb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:02.093259 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ba7a5bf-e1c2-4ce1-9c0b-223962ca76bb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:02.094010 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ba7a5bf-e1c2-4ce1-9c0b-223962ca76bb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:02.094440 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5ba7a5bf-e1c2-4ce1-9c0b-223962ca76bb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:02.219203 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5ba7a5bf-e1c2-4ce1-9c0b-223962ca76bb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:02.226518 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5ba7a5bf-e1c2-4ce1-9c0b-223962ca76bb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.144575 Jun 15 15:53:02.227295 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 187/379] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:02 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:03.243191 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-845627d9-c89f-4c11-b56d-142a71ab7949 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:03.243793 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-845627d9-c89f-4c11-b56d-142a71ab7949 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:03.249759 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-845627d9-c89f-4c11-b56d-142a71ab7949 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:03.250197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-845627d9-c89f-4c11-b56d-142a71ab7949 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:03.250976 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-845627d9-c89f-4c11-b56d-142a71ab7949 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:03.251405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-845627d9-c89f-4c11-b56d-142a71ab7949 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:03.383413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-845627d9-c89f-4c11-b56d-142a71ab7949 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:03.391676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-845627d9-c89f-4c11-b56d-142a71ab7949 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.151480 Jun 15 15:53:03.392235 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 193/380] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:03 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:04.167758 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f597c990-27f8-4587-9d27-3bd84b56f21c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90197496-be98-4543-a2d4-93de3f213695", "device": "/dev/sdb"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:04.169297 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f597c990-27f8-4587-9d27-3bd84b56f21c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:04.175252 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f597c990-27f8-4587-9d27-3bd84b56f21c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:04.175691 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f597c990-27f8-4587-9d27-3bd84b56f21c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:04.176434 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f597c990-27f8-4587-9d27-3bd84b56f21c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:04.176859 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f597c990-27f8-4587-9d27-3bd84b56f21c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:04.245753 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=81 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:04.410194 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ab3cf38e-f8b9-4bbf-8426-8a5b6c54e4e4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:04.410896 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ab3cf38e-f8b9-4bbf-8426-8a5b6c54e4e4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:04.417113 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab3cf38e-f8b9-4bbf-8426-8a5b6c54e4e4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:04.417534 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab3cf38e-f8b9-4bbf-8426-8a5b6c54e4e4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:04.418282 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab3cf38e-f8b9-4bbf-8426-8a5b6c54e4e4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:04.418742 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab3cf38e-f8b9-4bbf-8426-8a5b6c54e4e4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:04.460702 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f597c990-27f8-4587-9d27-3bd84b56f21c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "POST /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296488 Jun 15 15:53:04.461317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 188/381] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 15:53:04 2022] POST /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:53:04.558855 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ab3cf38e-f8b9-4bbf-8426-8a5b6c54e4e4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:04.566082 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ab3cf38e-f8b9-4bbf-8426-8a5b6c54e4e4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.160584 Jun 15 15:53:04.566639 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 194/382] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:04 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:05.583591 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-028f034f-6f46-4f6f-9b17-f6b72c98268d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:05.584284 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-028f034f-6f46-4f6f-9b17-f6b72c98268d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:05.591071 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-028f034f-6f46-4f6f-9b17-f6b72c98268d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:05.591519 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-028f034f-6f46-4f6f-9b17-f6b72c98268d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:05.592277 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-028f034f-6f46-4f6f-9b17-f6b72c98268d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:05.592709 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-028f034f-6f46-4f6f-9b17-f6b72c98268d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:05.722628 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-028f034f-6f46-4f6f-9b17-f6b72c98268d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:05.730723 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-028f034f-6f46-4f6f-9b17-f6b72c98268d tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.151314 Jun 15 15:53:05.731317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 189/383] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:05 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:06.747937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-469fd5ad-d0a9-454f-8ca6-11e1dad860c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:06.748838 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-469fd5ad-d0a9-454f-8ca6-11e1dad860c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:06.755899 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-469fd5ad-d0a9-454f-8ca6-11e1dad860c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:06.756348 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-469fd5ad-d0a9-454f-8ca6-11e1dad860c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:06.757103 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-469fd5ad-d0a9-454f-8ca6-11e1dad860c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:06.757537 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-469fd5ad-d0a9-454f-8ca6-11e1dad860c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:06.888169 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-469fd5ad-d0a9-454f-8ca6-11e1dad860c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:06.895530 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-469fd5ad-d0a9-454f-8ca6-11e1dad860c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.151554 Jun 15 15:53:06.896088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 195/384] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:06 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:07.912336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1711e2f1-9c2b-42c2-aba9-de5af1dfb7d4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:07.912945 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1711e2f1-9c2b-42c2-aba9-de5af1dfb7d4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:07.919676 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1711e2f1-9c2b-42c2-aba9-de5af1dfb7d4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:07.920128 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1711e2f1-9c2b-42c2-aba9-de5af1dfb7d4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:07.920890 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1711e2f1-9c2b-42c2-aba9-de5af1dfb7d4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:07.921322 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1711e2f1-9c2b-42c2-aba9-de5af1dfb7d4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:08.053326 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1711e2f1-9c2b-42c2-aba9-de5af1dfb7d4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:08.061364 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1711e2f1-9c2b-42c2-aba9-de5af1dfb7d4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.152815 Jun 15 15:53:08.062907 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 190/385] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:07 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:09.078298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-beb425f7-74a6-46e7-aad9-3921c3520a27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:09.079055 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-beb425f7-74a6-46e7-aad9-3921c3520a27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:09.085602 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-beb425f7-74a6-46e7-aad9-3921c3520a27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:09.086139 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-beb425f7-74a6-46e7-aad9-3921c3520a27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:09.086937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-beb425f7-74a6-46e7-aad9-3921c3520a27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:09.087371 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-beb425f7-74a6-46e7-aad9-3921c3520a27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:09.215201 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-beb425f7-74a6-46e7-aad9-3921c3520a27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:09.222667 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-beb425f7-74a6-46e7-aad9-3921c3520a27 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.148148 Jun 15 15:53:09.223195 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 196/386] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:09 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:10.239304 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2257c5da-36f7-4231-967b-fc1ca49b6e60 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:10.240442 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2257c5da-36f7-4231-967b-fc1ca49b6e60 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:10.248918 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2257c5da-36f7-4231-967b-fc1ca49b6e60 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:10.249378 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2257c5da-36f7-4231-967b-fc1ca49b6e60 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:10.250144 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2257c5da-36f7-4231-967b-fc1ca49b6e60 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:10.250578 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2257c5da-36f7-4231-967b-fc1ca49b6e60 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:10.383705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2257c5da-36f7-4231-967b-fc1ca49b6e60 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:10.391212 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2257c5da-36f7-4231-967b-fc1ca49b6e60 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1523 microversion: 2.1 time: 0.155850 Jun 15 15:53:10.391898 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 191/387] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:10 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:11.407956 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-125f6bb0-c1c1-4e4c-ad82-da2572580ca3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:11.408853 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-125f6bb0-c1c1-4e4c-ad82-da2572580ca3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:11.415662 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-125f6bb0-c1c1-4e4c-ad82-da2572580ca3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:11.416112 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-125f6bb0-c1c1-4e4c-ad82-da2572580ca3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:11.416875 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-125f6bb0-c1c1-4e4c-ad82-da2572580ca3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:11.417310 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-125f6bb0-c1c1-4e4c-ad82-da2572580ca3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:11.549149 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-125f6bb0-c1c1-4e4c-ad82-da2572580ca3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:11.558032 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-125f6bb0-c1c1-4e4c-ad82-da2572580ca3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1503 microversion: 2.1 time: 0.153919 Jun 15 15:53:11.559113 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 197/388] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:11 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:11.574639 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d8f4bdb3-1307-4047-ba28-bc156a8d7817 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:11.575349 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d8f4bdb3-1307-4047-ba28-bc156a8d7817 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:11.581825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8f4bdb3-1307-4047-ba28-bc156a8d7817 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:11.582340 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8f4bdb3-1307-4047-ba28-bc156a8d7817 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:11.583129 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8f4bdb3-1307-4047-ba28-bc156a8d7817 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:11.583558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8f4bdb3-1307-4047-ba28-bc156a8d7817 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:11.712236 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d8f4bdb3-1307-4047-ba28-bc156a8d7817 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:11.719660 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d8f4bdb3-1307-4047-ba28-bc156a8d7817 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1516 microversion: 2.1 time: 0.148829 Jun 15 15:53:11.720220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 192/389] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:11 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:13.066323 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ece380a9-1711-448b-9e7b-0f5a2a40726a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:13.067963 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ece380a9-1711-448b-9e7b-0f5a2a40726a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:13.074859 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ece380a9-1711-448b-9e7b-0f5a2a40726a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:13.075427 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ece380a9-1711-448b-9e7b-0f5a2a40726a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:13.076244 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ece380a9-1711-448b-9e7b-0f5a2a40726a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:13.076692 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ece380a9-1711-448b-9e7b-0f5a2a40726a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:13.079094 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=84 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:13.101780 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-ece380a9-1711-448b-9e7b-0f5a2a40726a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lazy-loading 'flavor' on Instance uuid c08c200b-6119-4bc7-955c-448d9956f01e {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:53:13.215608 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ece380a9-1711-448b-9e7b-0f5a2a40726a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "POST /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e/action" status: 200 len: 32 microversion: 2.1 time: 0.155409 Jun 15 15:53:13.216222 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 198/390] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 15:53:13 2022] POST /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:53:13.225167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-dcf12146-7bb8-446e-877b-7409479f3dc4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:13.225777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-dcf12146-7bb8-446e-877b-7409479f3dc4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:13.232609 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dcf12146-7bb8-446e-877b-7409479f3dc4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:13.233045 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dcf12146-7bb8-446e-877b-7409479f3dc4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:13.233822 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dcf12146-7bb8-446e-877b-7409479f3dc4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:13.234344 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dcf12146-7bb8-446e-877b-7409479f3dc4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:13.362353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-dcf12146-7bb8-446e-877b-7409479f3dc4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:13.370290 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-dcf12146-7bb8-446e-877b-7409479f3dc4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.149007 Jun 15 15:53:13.370866 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 193/391] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:13 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:14.387561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-40619f1f-7220-4345-837a-90125d8cd425 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:14.388262 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-40619f1f-7220-4345-837a-90125d8cd425 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:14.395171 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-40619f1f-7220-4345-837a-90125d8cd425 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:14.396194 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-40619f1f-7220-4345-837a-90125d8cd425 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:14.396961 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-40619f1f-7220-4345-837a-90125d8cd425 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:14.397385 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-40619f1f-7220-4345-837a-90125d8cd425 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:14.526697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-40619f1f-7220-4345-837a-90125d8cd425 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:14.534045 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-40619f1f-7220-4345-837a-90125d8cd425 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.150782 Jun 15 15:53:14.534603 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 199/392] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:14 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:15.551471 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fc5df9f4-54ae-4a35-aaf4-9512f92b28b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:15.552001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fc5df9f4-54ae-4a35-aaf4-9512f92b28b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:15.558421 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc5df9f4-54ae-4a35-aaf4-9512f92b28b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:15.558906 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc5df9f4-54ae-4a35-aaf4-9512f92b28b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:15.559665 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc5df9f4-54ae-4a35-aaf4-9512f92b28b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:15.560096 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc5df9f4-54ae-4a35-aaf4-9512f92b28b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:15.685802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fc5df9f4-54ae-4a35-aaf4-9512f92b28b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:15.693262 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fc5df9f4-54ae-4a35-aaf4-9512f92b28b4 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.145755 Jun 15 15:53:15.693816 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 194/393] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:15 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:16.709777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cf930ef5-5c96-4373-a33d-b5da999d10b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:16.710406 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-cf930ef5-5c96-4373-a33d-b5da999d10b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:16.716373 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf930ef5-5c96-4373-a33d-b5da999d10b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:16.716807 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf930ef5-5c96-4373-a33d-b5da999d10b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:16.717549 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf930ef5-5c96-4373-a33d-b5da999d10b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:16.717973 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf930ef5-5c96-4373-a33d-b5da999d10b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:16.841500 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cf930ef5-5c96-4373-a33d-b5da999d10b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:16.849504 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-cf930ef5-5c96-4373-a33d-b5da999d10b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.143554 Jun 15 15:53:16.850070 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 200/394] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:16 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:17.866870 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-aea4a9a2-6ece-4794-ad32-c976fec0173c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:17.867484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-aea4a9a2-6ece-4794-ad32-c976fec0173c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:17.874012 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aea4a9a2-6ece-4794-ad32-c976fec0173c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:17.874457 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aea4a9a2-6ece-4794-ad32-c976fec0173c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:17.875256 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aea4a9a2-6ece-4794-ad32-c976fec0173c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:17.875692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aea4a9a2-6ece-4794-ad32-c976fec0173c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:18.006723 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-aea4a9a2-6ece-4794-ad32-c976fec0173c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:18.014018 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-aea4a9a2-6ece-4794-ad32-c976fec0173c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.151582 Jun 15 15:53:18.014574 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 195/395] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:17 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:18.782070 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:53:18.782269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Wed Jun 15 15:53:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:53:19.030575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2ad6a7b0-6646-40d1-a1e2-891d9e845e0c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:19.031201 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2ad6a7b0-6646-40d1-a1e2-891d9e845e0c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:19.037638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2ad6a7b0-6646-40d1-a1e2-891d9e845e0c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:19.038035 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2ad6a7b0-6646-40d1-a1e2-891d9e845e0c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:19.038816 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2ad6a7b0-6646-40d1-a1e2-891d9e845e0c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:19.039250 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2ad6a7b0-6646-40d1-a1e2-891d9e845e0c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:19.163917 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2ad6a7b0-6646-40d1-a1e2-891d9e845e0c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:19.171937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2ad6a7b0-6646-40d1-a1e2-891d9e845e0c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.145226 Jun 15 15:53:19.172494 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 201/396] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:19 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:20.188720 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5264debc-a0d6-4811-9485-9fa89d4aca91 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:20.189346 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5264debc-a0d6-4811-9485-9fa89d4aca91 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:20.195879 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5264debc-a0d6-4811-9485-9fa89d4aca91 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:20.196315 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5264debc-a0d6-4811-9485-9fa89d4aca91 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:20.197058 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5264debc-a0d6-4811-9485-9fa89d4aca91 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:20.197486 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5264debc-a0d6-4811-9485-9fa89d4aca91 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:20.551938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5264debc-a0d6-4811-9485-9fa89d4aca91 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:20.559289 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5264debc-a0d6-4811-9485-9fa89d4aca91 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.374438 Jun 15 15:53:20.559843 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 196/397] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:20 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:21.575313 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4bc691dc-97eb-403f-97db-71e148a78e7a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:21.575920 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4bc691dc-97eb-403f-97db-71e148a78e7a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:21.581899 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4bc691dc-97eb-403f-97db-71e148a78e7a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:21.582340 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4bc691dc-97eb-403f-97db-71e148a78e7a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:21.583692 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4bc691dc-97eb-403f-97db-71e148a78e7a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:21.584126 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4bc691dc-97eb-403f-97db-71e148a78e7a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:21.706112 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4bc691dc-97eb-403f-97db-71e148a78e7a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:21.714023 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4bc691dc-97eb-403f-97db-71e148a78e7a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.142550 Jun 15 15:53:21.714583 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 202/398] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:21 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:22.729972 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ba17e2d4-5356-4d44-80b3-70dab27ff8c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:22.730558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ba17e2d4-5356-4d44-80b3-70dab27ff8c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:22.737046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ba17e2d4-5356-4d44-80b3-70dab27ff8c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:22.737491 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ba17e2d4-5356-4d44-80b3-70dab27ff8c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:22.738245 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ba17e2d4-5356-4d44-80b3-70dab27ff8c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:22.738680 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ba17e2d4-5356-4d44-80b3-70dab27ff8c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:22.864937 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ba17e2d4-5356-4d44-80b3-70dab27ff8c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:22.872348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ba17e2d4-5356-4d44-80b3-70dab27ff8c0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.146306 Jun 15 15:53:22.872904 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 197/399] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:22 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:23.889406 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-25451019-4f35-4cff-8472-bb514d3dabcd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:23.889997 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-25451019-4f35-4cff-8472-bb514d3dabcd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:23.896100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-25451019-4f35-4cff-8472-bb514d3dabcd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:23.896533 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-25451019-4f35-4cff-8472-bb514d3dabcd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:23.897274 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-25451019-4f35-4cff-8472-bb514d3dabcd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:23.897697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-25451019-4f35-4cff-8472-bb514d3dabcd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:23.980348 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:53:23.980501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 15:53:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e (ip 10.222.0.62) !!! Jun 15 15:53:24.022663 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-25451019-4f35-4cff-8472-bb514d3dabcd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:24.030038 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-25451019-4f35-4cff-8472-bb514d3dabcd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.144457 Jun 15 15:53:24.030596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 203/400] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:23 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:25.047053 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c0d00bd1-5d9c-40df-aae1-063984f985fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:25.047582 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c0d00bd1-5d9c-40df-aae1-063984f985fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:25.054108 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c0d00bd1-5d9c-40df-aae1-063984f985fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:25.054559 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c0d00bd1-5d9c-40df-aae1-063984f985fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:25.055355 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c0d00bd1-5d9c-40df-aae1-063984f985fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:25.055794 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c0d00bd1-5d9c-40df-aae1-063984f985fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:25.183949 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c0d00bd1-5d9c-40df-aae1-063984f985fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:25.191558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c0d00bd1-5d9c-40df-aae1-063984f985fa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.148454 Jun 15 15:53:25.192621 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 198/401] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:25 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:26.209379 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c56da0c6-b18d-4493-a786-6974d3b22287 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:26.209987 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c56da0c6-b18d-4493-a786-6974d3b22287 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:26.212064 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=30 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:26.217406 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c56da0c6-b18d-4493-a786-6974d3b22287 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:26.217853 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c56da0c6-b18d-4493-a786-6974d3b22287 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:26.218614 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c56da0c6-b18d-4493-a786-6974d3b22287 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:26.219080 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c56da0c6-b18d-4493-a786-6974d3b22287 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:26.349408 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c56da0c6-b18d-4493-a786-6974d3b22287 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:26.356723 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c56da0c6-b18d-4493-a786-6974d3b22287 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.151724 Jun 15 15:53:26.357279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 204/402] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:26 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:27.373421 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-debec0c2-9571-41ee-b078-673a4427fd1b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:27.374060 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-debec0c2-9571-41ee-b078-673a4427fd1b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:27.376524 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=30 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:27.382008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-debec0c2-9571-41ee-b078-673a4427fd1b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:27.382437 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-debec0c2-9571-41ee-b078-673a4427fd1b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:27.383225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-debec0c2-9571-41ee-b078-673a4427fd1b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:27.383653 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-debec0c2-9571-41ee-b078-673a4427fd1b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:27.508499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-debec0c2-9571-41ee-b078-673a4427fd1b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:27.522293 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-debec0c2-9571-41ee-b078-673a4427fd1b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.152659 Jun 15 15:53:27.522846 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 199/403] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:27 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:28.540025 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0954cd25-b265-4db1-9337-0b3b52fc0997 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:28.540624 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0954cd25-b265-4db1-9337-0b3b52fc0997 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:28.546563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0954cd25-b265-4db1-9337-0b3b52fc0997 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:28.547039 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0954cd25-b265-4db1-9337-0b3b52fc0997 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:28.547790 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0954cd25-b265-4db1-9337-0b3b52fc0997 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:28.548214 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0954cd25-b265-4db1-9337-0b3b52fc0997 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:28.675600 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0954cd25-b265-4db1-9337-0b3b52fc0997 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:28.683610 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0954cd25-b265-4db1-9337-0b3b52fc0997 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.148448 Jun 15 15:53:28.684158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 205/404] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:28 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:29.700347 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-57a05a72-98e8-4f22-bae7-b84779777005 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:29.700869 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-57a05a72-98e8-4f22-bae7-b84779777005 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:29.707749 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-57a05a72-98e8-4f22-bae7-b84779777005 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:29.708219 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-57a05a72-98e8-4f22-bae7-b84779777005 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:29.709685 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-57a05a72-98e8-4f22-bae7-b84779777005 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:29.710123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-57a05a72-98e8-4f22-bae7-b84779777005 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:29.838226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-57a05a72-98e8-4f22-bae7-b84779777005 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:29.845724 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-57a05a72-98e8-4f22-bae7-b84779777005 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.149315 Jun 15 15:53:29.846286 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 200/405] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:29 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:30.864336 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4196e8d6-7929-458f-aed2-c1f6b085f767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:30.865048 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4196e8d6-7929-458f-aed2-c1f6b085f767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:30.871109 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4196e8d6-7929-458f-aed2-c1f6b085f767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:30.871575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4196e8d6-7929-458f-aed2-c1f6b085f767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:30.872522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4196e8d6-7929-458f-aed2-c1f6b085f767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:30.872947 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4196e8d6-7929-458f-aed2-c1f6b085f767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:30.996360 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4196e8d6-7929-458f-aed2-c1f6b085f767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:31.003775 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4196e8d6-7929-458f-aed2-c1f6b085f767 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.145255 Jun 15 15:53:31.004334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 206/406] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:30 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:32.020837 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ffacf47b-a678-44a8-a8bc-1aeb2e48c8d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:32.021968 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ffacf47b-a678-44a8-a8bc-1aeb2e48c8d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:32.028562 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ffacf47b-a678-44a8-a8bc-1aeb2e48c8d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:32.029011 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ffacf47b-a678-44a8-a8bc-1aeb2e48c8d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:32.029777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ffacf47b-a678-44a8-a8bc-1aeb2e48c8d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:32.030211 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ffacf47b-a678-44a8-a8bc-1aeb2e48c8d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:32.166818 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ffacf47b-a678-44a8-a8bc-1aeb2e48c8d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:32.174379 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ffacf47b-a678-44a8-a8bc-1aeb2e48c8d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.157417 Jun 15 15:53:32.174973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 201/407] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:32 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:33.191419 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8377dac3-f202-4418-b4d3-5a465a1b4c28 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:33.192026 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8377dac3-f202-4418-b4d3-5a465a1b4c28 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:33.198016 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8377dac3-f202-4418-b4d3-5a465a1b4c28 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:33.198462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8377dac3-f202-4418-b4d3-5a465a1b4c28 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:33.199243 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8377dac3-f202-4418-b4d3-5a465a1b4c28 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:33.199679 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8377dac3-f202-4418-b4d3-5a465a1b4c28 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:33.239571 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5b07c75a-e8b9-4741-a325-f6257869bc21 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:33.241016 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5b07c75a-e8b9-4741-a325-f6257869bc21 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:33.247557 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b07c75a-e8b9-4741-a325-f6257869bc21 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:33.248028 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b07c75a-e8b9-4741-a325-f6257869bc21 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:33.248777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b07c75a-e8b9-4741-a325-f6257869bc21 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:33.249208 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b07c75a-e8b9-4741-a325-f6257869bc21 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:33.327699 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8377dac3-f202-4418-b4d3-5a465a1b4c28 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:33.335240 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8377dac3-f202-4418-b4d3-5a465a1b4c28 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.147701 Jun 15 15:53:33.335798 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 207/408] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:33 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:33.382434 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-5b07c75a-e8b9-4741-a325-f6257869bc21 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lazy-loading 'services' on Instance uuid cd894d3e-d369-42df-80c8-fb5ae7ed03ea {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:53:33.493776 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5b07c75a-e8b9-4741-a325-f6257869bc21 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea/os-volume_attachments/90197496-be98-4543-a2d4-93de3f213695" status: 202 len: 0 microversion: 2.1 time: 0.257913 Jun 15 15:53:33.494353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 202/409] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 15:53:33 2022] DELETE /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea/os-volume_attachments/90197496-be98-4543-a2d4-93de3f213695 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 15:53:34.352634 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8b45b265-eee6-4a9a-865b-235e171f57eb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:34.353268 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8b45b265-eee6-4a9a-865b-235e171f57eb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:34.359362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8b45b265-eee6-4a9a-865b-235e171f57eb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:34.359711 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8b45b265-eee6-4a9a-865b-235e171f57eb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:34.360493 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8b45b265-eee6-4a9a-865b-235e171f57eb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:34.361130 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8b45b265-eee6-4a9a-865b-235e171f57eb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:34.493208 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8b45b265-eee6-4a9a-865b-235e171f57eb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:34.500557 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8b45b265-eee6-4a9a-865b-235e171f57eb tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1502 microversion: 2.1 time: 0.152255 Jun 15 15:53:34.501112 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 208/410] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:34 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:34.518363 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-af7fbbc2-1d75-46bb-8a4a-34c37c71a7ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84acad35-36f1-402e-9f4e-72057fe10dc0"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:34.519671 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-af7fbbc2-1d75-46bb-8a4a-34c37c71a7ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:34.525948 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-af7fbbc2-1d75-46bb-8a4a-34c37c71a7ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:34.526423 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-af7fbbc2-1d75-46bb-8a4a-34c37c71a7ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:34.527209 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-af7fbbc2-1d75-46bb-8a4a-34c37c71a7ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:34.527638 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-af7fbbc2-1d75-46bb-8a4a-34c37c71a7ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:34.531299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:34.553722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-af7fbbc2-1d75-46bb-8a4a-34c37c71a7ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] HTTP exception thrown: Cannot 'attach_volume' instance c08c200b-6119-4bc7-955c-448d9956f01e while it is in vm_state rescued Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-af7fbbc2-1d75-46bb-8a4a-34c37c71a7ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Request method failure captured: Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: POST /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e/os-volume_attachments HTTP/1.1 Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 74 Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgAJQGYAJRl8YAWSmPSJEUL1Wp7YSAiHsrjh_EXMN13v3eyGOsp6BU_oMpiZd_kBcb2W-N_OFZbXfOcG-E9Fe7UGbRxs58tZ0yj78Bxro6IajNJkFyo7U9X9tDlMEha8AfDpzXzhRvv4bGqRBMii-zprZbYrs-1yOxD_a7hzl3rsPAs Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: f2ed62f01ef846569c069e52fcfee36a Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:53:34.555666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f2ed62f01ef846569c069e52fcfee36a", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: f2ed62f01ef846569c069e52fcfee36a Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-ServerRescueNegativeTestJSON-579752165-project Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: f8fcb09990db433e8ac0af3de37bdbc7 Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-ServerRescueNegativeTestJSON-579752165-project Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {"volumeAttachment": {"volumeId": "84acad35-36f1-402e-9f4e-72057fe10dc0"}} Jun 15 15:53:34.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Cannot 'attach_volume' instance c08c200b-6119-4bc7-955c-448d9956f01e while it is in vm_state rescued Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'server_id': 'c08c200b-6119-4bc7-955c-448d9956f01e', 'body': {'volumeAttachment': {'volumeId': '84acad35-36f1-402e-9f4e-72057fe10dc0'}}} Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c08c200b-6119-4bc7-955c-448d9956f01e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:53:34.557820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c08c200b-6119-4bc7-955c-448d9956f01e while it is in vm_state rescued Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:53:34.559220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:53:34.560954 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:53:34.560954 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:53:34.560954 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c08c200b-6119-4bc7-955c-448d9956f01e while it is in vm_state rescued Jun 15 15:53:34.560954 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:53:34.560954 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-af7fbbc2-1d75-46bb-8a4a-34c37c71a7ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Returning 409 to user: Cannot 'attach_volume' instance c08c200b-6119-4bc7-955c-448d9956f01e while it is in vm_state rescued {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:53:34.560954 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-af7fbbc2-1d75-46bb-8a4a-34c37c71a7ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "POST /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043697 Jun 15 15:53:34.560954 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 203/411] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 15:53:34 2022] POST /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 15 15:53:34.565830 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c9bd0b06-c333-4835-8fec-0416d5592370 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:34.566359 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c9bd0b06-c333-4835-8fec-0416d5592370 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:34.573163 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9bd0b06-c333-4835-8fec-0416d5592370 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:34.573605 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9bd0b06-c333-4835-8fec-0416d5592370 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:34.574358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9bd0b06-c333-4835-8fec-0416d5592370 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:34.574811 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9bd0b06-c333-4835-8fec-0416d5592370 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:34.639226 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c9bd0b06-c333-4835-8fec-0416d5592370 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "POST /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e/action" status: 202 len: 0 microversion: 2.1 time: 0.076976 Jun 15 15:53:34.640048 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 209/412] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 15:53:34 2022] POST /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:53:34.648796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4c3ad01e-ba00-4c64-ba29-cba156b2d474 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:34.649410 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4c3ad01e-ba00-4c64-ba29-cba156b2d474 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:34.655596 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4c3ad01e-ba00-4c64-ba29-cba156b2d474 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:34.656042 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4c3ad01e-ba00-4c64-ba29-cba156b2d474 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:34.656797 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4c3ad01e-ba00-4c64-ba29-cba156b2d474 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:34.657230 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4c3ad01e-ba00-4c64-ba29-cba156b2d474 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:34.785747 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4c3ad01e-ba00-4c64-ba29-cba156b2d474 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:34.793456 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4c3ad01e-ba00-4c64-ba29-cba156b2d474 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1510 microversion: 2.1 time: 0.149401 Jun 15 15:53:34.794023 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 204/413] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:34 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:35.667340 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-472574f1-e06b-4850-a2fa-8a59d4246ef0 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:35.667906 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-472574f1-e06b-4850-a2fa-8a59d4246ef0 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:35.674035 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-472574f1-e06b-4850-a2fa-8a59d4246ef0 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:35.674473 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-472574f1-e06b-4850-a2fa-8a59d4246ef0 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:35.675243 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-472574f1-e06b-4850-a2fa-8a59d4246ef0 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:35.675667 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-472574f1-e06b-4850-a2fa-8a59d4246ef0 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:35.699861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-472574f1-e06b-4850-a2fa-8a59d4246ef0 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Going to try to terminate instance {{(pid=123934) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:53:35.731354 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:35.772487 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-472574f1-e06b-4850-a2fa-8a59d4246ef0 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 204 len: 0 microversion: 2.1 time: 0.109979 Jun 15 15:53:35.773070 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 210/414] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:53:35 2022] DELETE /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:53:35.781142 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-dd3ecbaf-dc3b-4951-bbb1-fc68e217db55 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:35.781705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-dd3ecbaf-dc3b-4951-bbb1-fc68e217db55 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:35.788864 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dd3ecbaf-dc3b-4951-bbb1-fc68e217db55 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:35.789321 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dd3ecbaf-dc3b-4951-bbb1-fc68e217db55 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:35.790080 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dd3ecbaf-dc3b-4951-bbb1-fc68e217db55 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:35.790515 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dd3ecbaf-dc3b-4951-bbb1-fc68e217db55 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:35.811145 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3d6d2e95-ee4f-4260-8b82-e26a4d048fc3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:35.811839 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3d6d2e95-ee4f-4260-8b82-e26a4d048fc3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:35.817736 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3d6d2e95-ee4f-4260-8b82-e26a4d048fc3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:35.818222 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3d6d2e95-ee4f-4260-8b82-e26a4d048fc3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:35.819013 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3d6d2e95-ee4f-4260-8b82-e26a4d048fc3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:35.819447 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3d6d2e95-ee4f-4260-8b82-e26a4d048fc3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:35.988746 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-dd3ecbaf-dc3b-4951-bbb1-fc68e217db55 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:35.995411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3d6d2e95-ee4f-4260-8b82-e26a4d048fc3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:35.996231 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-dd3ecbaf-dc3b-4951-bbb1-fc68e217db55 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1511 microversion: 2.1 time: 0.218929 Jun 15 15:53:35.996790 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 205/415] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:35 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:36.002925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3d6d2e95-ee4f-4260-8b82-e26a4d048fc3 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1510 microversion: 2.1 time: 0.196005 Jun 15 15:53:36.003480 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 211/416] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:35 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:37.013312 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-06090c0f-d3d8-4642-ad3a-a18bb91a90fc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:37.014041 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-06090c0f-d3d8-4642-ad3a-a18bb91a90fc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:37.019413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9b0cc588-3e01-47fb-9a79-6836be70dfb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:37.020013 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9b0cc588-3e01-47fb-9a79-6836be70dfb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:37.020561 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-06090c0f-d3d8-4642-ad3a-a18bb91a90fc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:37.021013 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-06090c0f-d3d8-4642-ad3a-a18bb91a90fc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:37.021776 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-06090c0f-d3d8-4642-ad3a-a18bb91a90fc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:37.022211 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-06090c0f-d3d8-4642-ad3a-a18bb91a90fc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:37.026042 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9b0cc588-3e01-47fb-9a79-6836be70dfb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:37.026488 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9b0cc588-3e01-47fb-9a79-6836be70dfb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:37.027278 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9b0cc588-3e01-47fb-9a79-6836be70dfb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:37.027709 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9b0cc588-3e01-47fb-9a79-6836be70dfb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:37.215261 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-06090c0f-d3d8-4642-ad3a-a18bb91a90fc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:37.218425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-9b0cc588-3e01-47fb-9a79-6836be70dfb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:37.222980 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-06090c0f-d3d8-4642-ad3a-a18bb91a90fc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1511 microversion: 2.1 time: 0.213450 Jun 15 15:53:37.223829 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 206/417] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:37 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:37.226463 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9b0cc588-3e01-47fb-9a79-6836be70dfb2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1510 microversion: 2.1 time: 0.210834 Jun 15 15:53:37.227042 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 212/418] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:37 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:38.240615 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8640e6b7-df04-4894-bc85-e4168d0a38fe tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:38.241249 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-8640e6b7-df04-4894-bc85-e4168d0a38fe tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:38.242931 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f1545aab-8a33-4964-8018-da90e7aef971 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:38.243532 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f1545aab-8a33-4964-8018-da90e7aef971 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:38.247831 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8640e6b7-df04-4894-bc85-e4168d0a38fe tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:38.248311 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8640e6b7-df04-4894-bc85-e4168d0a38fe tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:38.249073 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8640e6b7-df04-4894-bc85-e4168d0a38fe tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:38.249365 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f1545aab-8a33-4964-8018-da90e7aef971 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:38.249565 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8640e6b7-df04-4894-bc85-e4168d0a38fe tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:38.249802 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f1545aab-8a33-4964-8018-da90e7aef971 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:38.250544 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f1545aab-8a33-4964-8018-da90e7aef971 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:38.250994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f1545aab-8a33-4964-8018-da90e7aef971 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:38.446236 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f1545aab-8a33-4964-8018-da90e7aef971 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:38.449117 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8640e6b7-df04-4894-bc85-e4168d0a38fe tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:38.453389 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f1545aab-8a33-4964-8018-da90e7aef971 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1510 microversion: 2.1 time: 0.214274 Jun 15 15:53:38.454155 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 213/419] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:38 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:38.456983 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-8640e6b7-df04-4894-bc85-e4168d0a38fe tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1511 microversion: 2.1 time: 0.220246 Jun 15 15:53:38.457914 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 207/420] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:38 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:39.471142 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ec68304f-ce6d-404a-97e1-bcb524bc388c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:39.471750 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ec68304f-ce6d-404a-97e1-bcb524bc388c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:39.474044 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0f2c3ec1-6040-4ec2-bb54-7a8bca65980b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:39.474668 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0f2c3ec1-6040-4ec2-bb54-7a8bca65980b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:39.477811 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ec68304f-ce6d-404a-97e1-bcb524bc388c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:39.478257 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ec68304f-ce6d-404a-97e1-bcb524bc388c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:39.479036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ec68304f-ce6d-404a-97e1-bcb524bc388c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:39.479467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ec68304f-ce6d-404a-97e1-bcb524bc388c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:39.481097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0f2c3ec1-6040-4ec2-bb54-7a8bca65980b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:39.481535 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0f2c3ec1-6040-4ec2-bb54-7a8bca65980b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:39.482279 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0f2c3ec1-6040-4ec2-bb54-7a8bca65980b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:39.482705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0f2c3ec1-6040-4ec2-bb54-7a8bca65980b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:39.673178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ec68304f-ce6d-404a-97e1-bcb524bc388c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:39.677267 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0f2c3ec1-6040-4ec2-bb54-7a8bca65980b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:39.681129 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ec68304f-ce6d-404a-97e1-bcb524bc388c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1510 microversion: 2.1 time: 0.213836 Jun 15 15:53:39.681697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 214/421] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:39 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:39.685087 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0f2c3ec1-6040-4ec2-bb54-7a8bca65980b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1511 microversion: 2.1 time: 0.214762 Jun 15 15:53:39.685633 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 208/422] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:39 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:40.698129 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a05b86ec-71aa-4a79-b042-1f412519be3b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:40.698871 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a05b86ec-71aa-4a79-b042-1f412519be3b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:40.702963 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c9a1c47a-2be4-4284-9fd0-7ad011ea7a0c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:40.703542 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c9a1c47a-2be4-4284-9fd0-7ad011ea7a0c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:40.705094 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a05b86ec-71aa-4a79-b042-1f412519be3b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:40.705551 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a05b86ec-71aa-4a79-b042-1f412519be3b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:40.706472 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a05b86ec-71aa-4a79-b042-1f412519be3b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:40.706766 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a05b86ec-71aa-4a79-b042-1f412519be3b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:40.709927 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c9a1c47a-2be4-4284-9fd0-7ad011ea7a0c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:40.710383 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c9a1c47a-2be4-4284-9fd0-7ad011ea7a0c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:40.711927 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c9a1c47a-2be4-4284-9fd0-7ad011ea7a0c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:40.711927 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c9a1c47a-2be4-4284-9fd0-7ad011ea7a0c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:40.907305 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a05b86ec-71aa-4a79-b042-1f412519be3b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:40.912934 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c9a1c47a-2be4-4284-9fd0-7ad011ea7a0c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:40.915593 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a05b86ec-71aa-4a79-b042-1f412519be3b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1516 microversion: 2.1 time: 0.221285 Jun 15 15:53:40.916287 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 215/423] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:40 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:40.923960 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c9a1c47a-2be4-4284-9fd0-7ad011ea7a0c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1511 microversion: 2.1 time: 0.225496 Jun 15 15:53:40.935277 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 209/424] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:40 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:41.039448 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-a11f0388-d900-4eb5-99a8-b0c9b3b4c4cb req-755c6147-1b0c-4641-b299-670837e4456e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd894d3e-d369-42df-80c8-fb5ae7ed03ea", "name": "network-vif-deleted", "tag": "fb40b76c-ac84-484b-9777-63cbb798edb4"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:41.051313 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-a11f0388-d900-4eb5-99a8-b0c9b3b4c4cb req-755c6147-1b0c-4641-b299-670837e4456e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:41.051750 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-a11f0388-d900-4eb5-99a8-b0c9b3b4c4cb req-755c6147-1b0c-4641-b299-670837e4456e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:41.063336 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-a11f0388-d900-4eb5-99a8-b0c9b3b4c4cb req-755c6147-1b0c-4641-b299-670837e4456e service nova] Creating event network-vif-deleted:fb40b76c-ac84-484b-9777-63cbb798edb4 for instance cd894d3e-d369-42df-80c8-fb5ae7ed03ea on hv-cinder-84599 Jun 15 15:53:41.068272 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-a11f0388-d900-4eb5-99a8-b0c9b3b4c4cb req-755c6147-1b0c-4641-b299-670837e4456e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034179 Jun 15 15:53:41.069030 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 216/425] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:53:41.942408 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e0aa798b-9087-4866-b4d2-5720045bcc07 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:41.943049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e0aa798b-9087-4866-b4d2-5720045bcc07 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:41.950227 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e0aa798b-9087-4866-b4d2-5720045bcc07 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:41.950989 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e0aa798b-9087-4866-b4d2-5720045bcc07 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:41.951935 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e0aa798b-9087-4866-b4d2-5720045bcc07 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:41.952445 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e0aa798b-9087-4866-b4d2-5720045bcc07 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:41.992306 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e0aa798b-9087-4866-b4d2-5720045bcc07 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:41.992750 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e0aa798b-9087-4866-b4d2-5720045bcc07 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:41.993198 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-e0aa798b-9087-4866-b4d2-5720045bcc07 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lazy-loading 'fault' on Instance uuid cd894d3e-d369-42df-80c8-fb5ae7ed03ea {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:53:42.039733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e0aa798b-9087-4866-b4d2-5720045bcc07 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:42.047494 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e0aa798b-9087-4866-b4d2-5720045bcc07 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 200 len: 1308 microversion: 2.1 time: 0.109703 Jun 15 15:53:42.048183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 210/426] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:41 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:42.284972 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-01fcf2e5-b873-489a-98d8-0086465448ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Action: 'create', calling method: .version_select at 0x7fd8d8444040>, body: {"keypair": {"name": "tempest-keypair-2057632781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGS/ymhrKCwim2BQTzFvhytk3vtnDReIt5Cxnd9nJKhKzlgtdfk3ZdXp874ko4Y1HdR2dut6kxqxPbmcKxR9Ve4lUUWLoZO7gE5Oro5KO1/9YaQ2rd1F3oJimmJ5q6LAtg=="}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:42.299356 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-01fcf2e5-b873-489a-98d8-0086465448ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Getting quotas for project f2ed62f01ef846569c069e52fcfee36a. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:53:42.303254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-01fcf2e5-b873-489a-98d8-0086465448ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Getting quotas for user f8fcb09990db433e8ac0af3de37bdbc7 and project f2ed62f01ef846569c069e52fcfee36a. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:53:42.328921 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-01fcf2e5-b873-489a-98d8-0086465448ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048078 Jun 15 15:53:42.329508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 217/427] 10.222.0.62 () {60 vars in 1158 bytes} [Wed Jun 15 15:53:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:53:43.064938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a4a7c213-ffb5-4ab7-bc3a-c210c66d7f8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:43.065459 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a4a7c213-ffb5-4ab7-bc3a-c210c66d7f8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: cd894d3e-d369-42df-80c8-fb5ae7ed03ea] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:43.072050 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4a7c213-ffb5-4ab7-bc3a-c210c66d7f8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:43.072507 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4a7c213-ffb5-4ab7-bc3a-c210c66d7f8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:43.073265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4a7c213-ffb5-4ab7-bc3a-c210c66d7f8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:43.073695 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4a7c213-ffb5-4ab7-bc3a-c210c66d7f8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:43.087161 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-a4a7c213-ffb5-4ab7-bc3a-c210c66d7f8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] HTTP exception thrown: Instance cd894d3e-d369-42df-80c8-fb5ae7ed03ea could not be found. Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a4a7c213-ffb5-4ab7-bc3a-c210c66d7f8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Request method failure captured: Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea HTTP/1.1 Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgAHiuO-TDwQKov1OBEBvoOIv-EGzRCYFgcKK40mAtrBAXnmBPZ0F3--akQqnFz3koOuwYFnaqnYfhq7qCJCd0DdJM1IvwxPEPb-GNoJ3CYDCwsdaifbvHOuOONf4fm9FNjxZcbQD6jpOMUIqGofPcTqdWghF_UfO9yLxqdqtQwCEps Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: bf53255e905344409fd64e4fba710dbc Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2112844530 Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:53:43.088692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bf53255e905344409fd64e4fba710dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bf53255e905344409fd64e4fba710dbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bf53255e905344409fd64e4fba710dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bf53255e905344409fd64e4fba710dbc", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-VolumesSnapshotTestJSON-2112844530 Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: bf53255e905344409fd64e4fba710dbc Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2112844530 Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-VolumesSnapshotTestJSON-2112844530-project Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: e872bc2e7b214f0889ba95cc9352c59b Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-VolumesSnapshotTestJSON-2112844530-project Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance cd894d3e-d369-42df-80c8-fb5ae7ed03ea could not be found. Jun 15 15:53:43.090305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'cd894d3e-d369-42df-80c8-fb5ae7ed03ea'} Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd894d3e-d369-42df-80c8-fb5ae7ed03ea could not be found. Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:53:43.091237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd894d3e-d369-42df-80c8-fb5ae7ed03ea could not be found. Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd894d3e-d369-42df-80c8-fb5ae7ed03ea could not be found. Jun 15 15:53:43.092503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:53:43.093590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a4a7c213-ffb5-4ab7-bc3a-c210c66d7f8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Returning 404 to user: Instance cd894d3e-d369-42df-80c8-fb5ae7ed03ea could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:53:43.093590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a4a7c213-ffb5-4ab7-bc3a-c210c66d7f8a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea" status: 404 len: 111 microversion: 2.1 time: 0.029152 Jun 15 15:53:43.093590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 211/428] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:43 2022] GET /compute/v2.1/servers/cd894d3e-d369-42df-80c8-fb5ae7ed03ea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:53:43.568544 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-188452221", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2bc02b29-820d-4edc-a805-2d2f552df736"}], "security_groups": [{"name": "tempest-securitygroup--317528781"}], "key_name": "tempest-keypair-2057632781", "user_data": "}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:43.688578 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.network.neutron [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] validate_networks() for [('2bc02b29-820d-4edc-a805-2d2f552df736', None, None, None, None, None)] {{(pid=123934) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:53:44.055199 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Flavor limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:53:44.055615 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Image limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:53:44.056109 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Flavor pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:53:44.056520 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Image pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:53:44.056923 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:53:44.065977 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:44.066421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:44.067238 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:44.067668 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:44.085338 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Getting quotas for project f2ed62f01ef846569c069e52fcfee36a. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:53:44.089343 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Getting quotas for user f8fcb09990db433e8ac0af3de37bdbc7 and project f2ed62f01ef846569c069e52fcfee36a. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:53:44.100025 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Going to run 1 instances... {{(pid=123934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:53:44.102330 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:53:44.147825 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2852931c-920f-45cd-ac01-136e4465a0b7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.583553 Jun 15 15:53:44.148485 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 218/429] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:53:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:53:44.158212 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d481b584-b98c-4b53-bd20-9bf6da45e40c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:44.158850 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d481b584-b98c-4b53-bd20-9bf6da45e40c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:44.211929 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d481b584-b98c-4b53-bd20-9bf6da45e40c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:44.218520 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d481b584-b98c-4b53-bd20-9bf6da45e40c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1245 microversion: 2.1 time: 0.064131 Jun 15 15:53:44.219120 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 212/430] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:44 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1245 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:45.235320 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3607d146-b66f-4b18-b96f-74c17271ef8c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:45.235930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3607d146-b66f-4b18-b96f-74c17271ef8c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:45.242828 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3607d146-b66f-4b18-b96f-74c17271ef8c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:45.243277 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3607d146-b66f-4b18-b96f-74c17271ef8c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:45.244029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3607d146-b66f-4b18-b96f-74c17271ef8c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:45.244455 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3607d146-b66f-4b18-b96f-74c17271ef8c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:45.304885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3607d146-b66f-4b18-b96f-74c17271ef8c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:45.312349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3607d146-b66f-4b18-b96f-74c17271ef8c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1249 microversion: 2.1 time: 0.080950 Jun 15 15:53:45.312905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 219/431] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:45 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:46.329165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5e5cf013-ec54-4996-b828-42baa54a6a59 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:46.329773 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5e5cf013-ec54-4996-b828-42baa54a6a59 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:46.337346 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5e5cf013-ec54-4996-b828-42baa54a6a59 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:46.337801 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5e5cf013-ec54-4996-b828-42baa54a6a59 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:46.338567 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5e5cf013-ec54-4996-b828-42baa54a6a59 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:46.339029 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5e5cf013-ec54-4996-b828-42baa54a6a59 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:46.397867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5e5cf013-ec54-4996-b828-42baa54a6a59 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:46.405189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5e5cf013-ec54-4996-b828-42baa54a6a59 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1249 microversion: 2.1 time: 0.079912 Jun 15 15:53:46.405744 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 213/432] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:46 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:47.421614 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-671080ca-2156-4233-ba03-80143fa25ed0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:47.422229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-671080ca-2156-4233-ba03-80143fa25ed0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:47.429202 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-671080ca-2156-4233-ba03-80143fa25ed0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:47.429651 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-671080ca-2156-4233-ba03-80143fa25ed0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:47.430409 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-671080ca-2156-4233-ba03-80143fa25ed0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:47.430900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-671080ca-2156-4233-ba03-80143fa25ed0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:47.495680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-671080ca-2156-4233-ba03-80143fa25ed0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:47.503667 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-671080ca-2156-4233-ba03-80143fa25ed0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1297 microversion: 2.1 time: 0.085967 Jun 15 15:53:47.504222 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 220/433] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:47 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:47.855338 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3454dae4-5aa7-4bdf-b8b2-182b9aebde1d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:47.855828 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3454dae4-5aa7-4bdf-b8b2-182b9aebde1d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:47.862249 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3454dae4-5aa7-4bdf-b8b2-182b9aebde1d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:47.862694 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3454dae4-5aa7-4bdf-b8b2-182b9aebde1d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:47.863478 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3454dae4-5aa7-4bdf-b8b2-182b9aebde1d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:47.863906 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3454dae4-5aa7-4bdf-b8b2-182b9aebde1d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:47.887043 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3454dae4-5aa7-4bdf-b8b2-182b9aebde1d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/ips" status: 200 len: 146 microversion: 2.1 time: 0.035539 Jun 15 15:53:47.887583 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 214/434] 10.222.0.62 () {58 vars in 1247 bytes} [Wed Jun 15 15:53:47 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:53:48.526268 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-17195df1-865c-4b2b-aaaa-7929eb77286a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:48.526701 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-17195df1-865c-4b2b-aaaa-7929eb77286a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:48.538911 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17195df1-865c-4b2b-aaaa-7929eb77286a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:48.539646 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17195df1-865c-4b2b-aaaa-7929eb77286a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:48.540548 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17195df1-865c-4b2b-aaaa-7929eb77286a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:48.541041 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-17195df1-865c-4b2b-aaaa-7929eb77286a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:48.723075 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-17195df1-865c-4b2b-aaaa-7929eb77286a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:48.732956 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-17195df1-865c-4b2b-aaaa-7929eb77286a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.212072 Jun 15 15:53:48.735445 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 221/435] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:48 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:49.156901 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-99a29add-bd55-49aa-abe0-770d4166864b req-d27f886c-b825-43f1-89eb-000efabe4bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76bb4599-da4d-40fb-8de1-12edf17a8384", "tag": "a4dbc8ca-933e-46fd-9b4c-8dc00d37465e"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:49.167215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-99a29add-bd55-49aa-abe0-770d4166864b req-d27f886c-b825-43f1-89eb-000efabe4bcc service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:49.167607 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-99a29add-bd55-49aa-abe0-770d4166864b req-d27f886c-b825-43f1-89eb-000efabe4bcc service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:49.186847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-99a29add-bd55-49aa-abe0-770d4166864b req-d27f886c-b825-43f1-89eb-000efabe4bcc service nova] Creating event network-changed:a4dbc8ca-933e-46fd-9b4c-8dc00d37465e for instance 76bb4599-da4d-40fb-8de1-12edf17a8384 on hv-cinder-84599 Jun 15 15:53:49.192167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-99a29add-bd55-49aa-abe0-770d4166864b req-d27f886c-b825-43f1-89eb-000efabe4bcc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038877 Jun 15 15:53:49.192776 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 215/436] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:53:49.749446 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bcb89a36-cd9f-4b31-a122-81bd2a1fd3f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:49.750138 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bcb89a36-cd9f-4b31-a122-81bd2a1fd3f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:49.756770 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bcb89a36-cd9f-4b31-a122-81bd2a1fd3f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:49.757215 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bcb89a36-cd9f-4b31-a122-81bd2a1fd3f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:49.757967 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bcb89a36-cd9f-4b31-a122-81bd2a1fd3f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:49.758401 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bcb89a36-cd9f-4b31-a122-81bd2a1fd3f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:49.900534 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bcb89a36-cd9f-4b31-a122-81bd2a1fd3f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:49.907915 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bcb89a36-cd9f-4b31-a122-81bd2a1fd3f8 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.162332 Jun 15 15:53:49.908477 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 222/437] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:49 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:49.992308 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-efdd803a-5318-49e2-8c81-f6f4253689b8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "423edf20-d8ab-4b07-b3e6-fdfc6f3536ed"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:49.993444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-efdd803a-5318-49e2-8c81-f6f4253689b8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:49.999618 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-efdd803a-5318-49e2-8c81-f6f4253689b8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:50.000074 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-efdd803a-5318-49e2-8c81-f6f4253689b8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:50.000886 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-efdd803a-5318-49e2-8c81-f6f4253689b8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:50.001324 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-efdd803a-5318-49e2-8c81-f6f4253689b8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:50.923933 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-47e72152-7880-4d93-b3aa-dd04c2abb753 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:50.924542 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-47e72152-7880-4d93-b3aa-dd04c2abb753 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:50.930549 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47e72152-7880-4d93-b3aa-dd04c2abb753 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:50.931029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47e72152-7880-4d93-b3aa-dd04c2abb753 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:50.931783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47e72152-7880-4d93-b3aa-dd04c2abb753 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:50.932216 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47e72152-7880-4d93-b3aa-dd04c2abb753 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:51.062665 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-47e72152-7880-4d93-b3aa-dd04c2abb753 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:51.070119 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-47e72152-7880-4d93-b3aa-dd04c2abb753 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.150041 Jun 15 15:53:51.070669 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 223/438] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:50 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:52.086439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-99578be3-3b09-4d28-b7ec-f9067fbad630 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:52.087081 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-99578be3-3b09-4d28-b7ec-f9067fbad630 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:52.093078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-99578be3-3b09-4d28-b7ec-f9067fbad630 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:52.093528 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-99578be3-3b09-4d28-b7ec-f9067fbad630 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:52.094284 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-99578be3-3b09-4d28-b7ec-f9067fbad630 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:52.094784 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-99578be3-3b09-4d28-b7ec-f9067fbad630 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:52.221009 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-99578be3-3b09-4d28-b7ec-f9067fbad630 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:52.228994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-99578be3-3b09-4d28-b7ec-f9067fbad630 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.146401 Jun 15 15:53:52.229592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 224/439] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:52 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:53.246148 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3a0f45f4-cc4c-4c5e-ae1d-a7ec5ff25f66 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:53.246791 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3a0f45f4-cc4c-4c5e-ae1d-a7ec5ff25f66 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:53.252676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3a0f45f4-cc4c-4c5e-ae1d-a7ec5ff25f66 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:53.253112 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3a0f45f4-cc4c-4c5e-ae1d-a7ec5ff25f66 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:53.253853 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3a0f45f4-cc4c-4c5e-ae1d-a7ec5ff25f66 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:53.254277 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3a0f45f4-cc4c-4c5e-ae1d-a7ec5ff25f66 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:53.384244 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3a0f45f4-cc4c-4c5e-ae1d-a7ec5ff25f66 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:53.391558 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3a0f45f4-cc4c-4c5e-ae1d-a7ec5ff25f66 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.149327 Jun 15 15:53:53.392104 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 225/440] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:53 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:54.216590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:54.408011 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c89a5dbd-c546-4247-9a48-0ad599e1cf7c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:54.408647 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c89a5dbd-c546-4247-9a48-0ad599e1cf7c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:54.410623 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:54.411377 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=10 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:54.417670 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c89a5dbd-c546-4247-9a48-0ad599e1cf7c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:54.418109 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c89a5dbd-c546-4247-9a48-0ad599e1cf7c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:54.418910 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c89a5dbd-c546-4247-9a48-0ad599e1cf7c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:54.419336 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c89a5dbd-c546-4247-9a48-0ad599e1cf7c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:54.548151 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c89a5dbd-c546-4247-9a48-0ad599e1cf7c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:54.556109 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c89a5dbd-c546-4247-9a48-0ad599e1cf7c tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.151978 Jun 15 15:53:54.557038 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 226/441] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:54 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:55.089357 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1248027119", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "networks": [{"uuid": "18f9d829-801b-468b-b861-5aa1d47f331c"}]}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:55.138313 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.network.neutron [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] validate_networks() for [('18f9d829-801b-468b-b861-5aa1d47f331c', None, None, None, None, None)] {{(pid=123934) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:53:55.476546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Flavor limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:53:55.477078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Image limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:53:55.477446 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Flavor pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:53:55.477849 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Image pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:53:55.478251 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:53:55.486799 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:55.487241 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:55.488024 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:55.488452 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:55.506501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Getting quotas for project bf53255e905344409fd64e4fba710dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:53:55.510150 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Getting quotas for user e872bc2e7b214f0889ba95cc9352c59b and project bf53255e905344409fd64e4fba710dbc. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:53:55.520701 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Going to run 1 instances... {{(pid=123934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:53:55.522768 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:53:55.566422 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f89efb4d-12a6-4926-adc5-e90b9634c7b2 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.481358 Jun 15 15:53:55.567292 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 227/442] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:53:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:53:55.573124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2f82f4d2-0157-40ad-9504-60de8edf42d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:55.574063 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2f82f4d2-0157-40ad-9504-60de8edf42d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:55.580369 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2f82f4d2-0157-40ad-9504-60de8edf42d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:55.580819 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2f82f4d2-0157-40ad-9504-60de8edf42d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:55.581674 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2f82f4d2-0157-40ad-9504-60de8edf42d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:55.582679 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2f82f4d2-0157-40ad-9504-60de8edf42d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:55.721900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2f82f4d2-0157-40ad-9504-60de8edf42d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:55.730091 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2f82f4d2-0157-40ad-9504-60de8edf42d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.160789 Jun 15 15:53:55.730645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 228/443] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:55 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:55.734956 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a407c09a-dc75-45a9-80b6-adb8170fcc9c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:55.735539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a407c09a-dc75-45a9-80b6-adb8170fcc9c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:55.791368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a407c09a-dc75-45a9-80b6-adb8170fcc9c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:55.797960 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a407c09a-dc75-45a9-80b6-adb8170fcc9c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1219 microversion: 2.1 time: 0.066369 Jun 15 15:53:55.798513 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 229/444] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:55 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:56.580269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-efdd803a-5318-49e2-8c81-f6f4253689b8 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "POST /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.592518 Jun 15 15:53:56.581023 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 216/445] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 15:53:49 2022] POST /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/os-volume_attachments => generated 194 bytes in 6594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:53:56.746796 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-521aeb82-d63d-447c-808f-cebd0da57161 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:56.747430 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-521aeb82-d63d-447c-808f-cebd0da57161 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:56.749280 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:56.754352 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-521aeb82-d63d-447c-808f-cebd0da57161 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:56.754835 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-521aeb82-d63d-447c-808f-cebd0da57161 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:56.756296 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-521aeb82-d63d-447c-808f-cebd0da57161 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:56.756767 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-521aeb82-d63d-447c-808f-cebd0da57161 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:56.816542 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ca6ddc92-5e06-4805-86c3-f5858bfa1ce9 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:56.817235 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ca6ddc92-5e06-4805-86c3-f5858bfa1ce9 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:56.824686 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ca6ddc92-5e06-4805-86c3-f5858bfa1ce9 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:56.825131 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ca6ddc92-5e06-4805-86c3-f5858bfa1ce9 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:56.825895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ca6ddc92-5e06-4805-86c3-f5858bfa1ce9 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:56.826325 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ca6ddc92-5e06-4805-86c3-f5858bfa1ce9 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:56.888167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ca6ddc92-5e06-4805-86c3-f5858bfa1ce9 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:56.895533 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ca6ddc92-5e06-4805-86c3-f5858bfa1ce9 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1271 microversion: 2.1 time: 0.083675 Jun 15 15:53:56.896097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 217/446] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:56 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:56.908539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-521aeb82-d63d-447c-808f-cebd0da57161 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:56.910832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:56.917986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-521aeb82-d63d-447c-808f-cebd0da57161 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.175113 Jun 15 15:53:56.918576 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 230/447] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:56 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:57.092921 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c303371a-4224-4e1a-958f-21aa7eb30b97 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:57.093733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c303371a-4224-4e1a-958f-21aa7eb30b97 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:57.100838 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c303371a-4224-4e1a-958f-21aa7eb30b97 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:57.102510 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c303371a-4224-4e1a-958f-21aa7eb30b97 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:57.103327 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c303371a-4224-4e1a-958f-21aa7eb30b97 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:57.103921 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c303371a-4224-4e1a-958f-21aa7eb30b97 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:57.131612 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c303371a-4224-4e1a-958f-21aa7eb30b97 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/ips" status: 200 len: 149 microversion: 2.1 time: 0.042674 Jun 15 15:53:57.132253 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 218/448] 10.222.0.62 () {58 vars in 1247 bytes} [Wed Jun 15 15:53:57 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:53:57.913512 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-13a7dc0d-6904-40db-81f2-5dd3481f1516 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:57.914111 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-13a7dc0d-6904-40db-81f2-5dd3481f1516 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:57.920408 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-13a7dc0d-6904-40db-81f2-5dd3481f1516 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:57.920847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-13a7dc0d-6904-40db-81f2-5dd3481f1516 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:57.921590 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-13a7dc0d-6904-40db-81f2-5dd3481f1516 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:57.922011 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-13a7dc0d-6904-40db-81f2-5dd3481f1516 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:57.936308 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a410531a-8edd-4c0b-b86e-54b237212ce0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:57.937079 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a410531a-8edd-4c0b-b86e-54b237212ce0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:57.939799 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=44 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:53:57.947791 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a410531a-8edd-4c0b-b86e-54b237212ce0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:57.949004 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a410531a-8edd-4c0b-b86e-54b237212ce0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:57.950145 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a410531a-8edd-4c0b-b86e-54b237212ce0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:57.951020 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a410531a-8edd-4c0b-b86e-54b237212ce0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:58.002968 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-13a7dc0d-6904-40db-81f2-5dd3481f1516 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:58.010698 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-13a7dc0d-6904-40db-81f2-5dd3481f1516 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1277 microversion: 2.1 time: 0.101881 Jun 15 15:53:58.011295 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 231/449] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:57 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:58.100710 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a410531a-8edd-4c0b-b86e-54b237212ce0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:58.108088 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a410531a-8edd-4c0b-b86e-54b237212ce0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.177000 Jun 15 15:53:58.108664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 219/450] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:57 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:58.882209 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-d560946c-d720-4843-937b-3ae332cad7be req-55b467f5-c3dc-461a-9925-d21f76d8e5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ca2bc05-4595-4e21-8291-04ab2e2d8969", "tag": "9503184b-fdbc-4d44-acd4-a547060db68b"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:58.890543 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-d560946c-d720-4843-937b-3ae332cad7be req-55b467f5-c3dc-461a-9925-d21f76d8e5b3 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:58.891035 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-d560946c-d720-4843-937b-3ae332cad7be req-55b467f5-c3dc-461a-9925-d21f76d8e5b3 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:58.902524 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-d560946c-d720-4843-937b-3ae332cad7be req-55b467f5-c3dc-461a-9925-d21f76d8e5b3 service nova] Creating event network-changed:9503184b-fdbc-4d44-acd4-a547060db68b for instance 3ca2bc05-4595-4e21-8291-04ab2e2d8969 on hv-cinder-84599 Jun 15 15:53:58.907345 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-d560946c-d720-4843-937b-3ae332cad7be req-55b467f5-c3dc-461a-9925-d21f76d8e5b3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029354 Jun 15 15:53:58.908119 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 232/451] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:53:59.027786 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-55b12625-56d1-440d-9d9c-63b14a4fa662 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:59.028384 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-55b12625-56d1-440d-9d9c-63b14a4fa662 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:59.034819 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55b12625-56d1-440d-9d9c-63b14a4fa662 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:59.035263 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55b12625-56d1-440d-9d9c-63b14a4fa662 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:59.036012 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55b12625-56d1-440d-9d9c-63b14a4fa662 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:59.036438 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55b12625-56d1-440d-9d9c-63b14a4fa662 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:59.125683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-75736069-84f4-4430-a55d-0d4db13d197a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:53:59.126364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-75736069-84f4-4430-a55d-0d4db13d197a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:59.133314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-75736069-84f4-4430-a55d-0d4db13d197a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:59.133756 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-75736069-84f4-4430-a55d-0d4db13d197a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:59.134511 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-75736069-84f4-4430-a55d-0d4db13d197a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:59.134975 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-75736069-84f4-4430-a55d-0d4db13d197a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:59.163676 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-55b12625-56d1-440d-9d9c-63b14a4fa662 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:59.175668 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-55b12625-56d1-440d-9d9c-63b14a4fa662 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1319 microversion: 2.1 time: 0.151549 Jun 15 15:53:59.176391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 220/452] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:59 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:53:59.275715 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-75736069-84f4-4430-a55d-0d4db13d197a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:53:59.284323 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-75736069-84f4-4430-a55d-0d4db13d197a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.162596 Jun 15 15:53:59.294506 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 233/453] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:53:59 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:53:59.506984 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-a67c0210-00ca-457e-aa18-4983e062c215 req-f0a26fa8-50af-424c-a00a-342f5272ada9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76bb4599-da4d-40fb-8de1-12edf17a8384", "name": "network-vif-plugged", "status": "completed", "tag": "a4dbc8ca-933e-46fd-9b4c-8dc00d37465e"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:59.516643 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-a67c0210-00ca-457e-aa18-4983e062c215 req-f0a26fa8-50af-424c-a00a-342f5272ada9 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:59.517187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-a67c0210-00ca-457e-aa18-4983e062c215 req-f0a26fa8-50af-424c-a00a-342f5272ada9 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:59.529286 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-a67c0210-00ca-457e-aa18-4983e062c215 req-f0a26fa8-50af-424c-a00a-342f5272ada9 service nova] Creating event network-vif-plugged:a4dbc8ca-933e-46fd-9b4c-8dc00d37465e for instance 76bb4599-da4d-40fb-8de1-12edf17a8384 on hv-cinder-84599 Jun 15 15:53:59.534369 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-a67c0210-00ca-457e-aa18-4983e062c215 req-f0a26fa8-50af-424c-a00a-342f5272ada9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030914 Jun 15 15:53:59.535001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 221/454] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:53:59.605036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5d8c1b12-88aa-41a9-9518-63ad4865d94f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7a1f700-966d-471b-a902-b982c2cbf4c8"}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:53:59.606110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5d8c1b12-88aa-41a9-9518-63ad4865d94f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:53:59.613352 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5d8c1b12-88aa-41a9-9518-63ad4865d94f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:59.613803 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5d8c1b12-88aa-41a9-9518-63ad4865d94f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:59.615859 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5d8c1b12-88aa-41a9-9518-63ad4865d94f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:53:59.616636 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5d8c1b12-88aa-41a9-9518-63ad4865d94f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:53:59.923224 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5d8c1b12-88aa-41a9-9518-63ad4865d94f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321967 Jun 15 15:53:59.923827 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 234/455] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 15:53:59 2022] POST /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:54:00.193870 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-581bdffc-2f3c-4fe4-9e5d-233fa8639514 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:00.194591 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-581bdffc-2f3c-4fe4-9e5d-233fa8639514 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:00.200778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-581bdffc-2f3c-4fe4-9e5d-233fa8639514 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:00.201217 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-581bdffc-2f3c-4fe4-9e5d-233fa8639514 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:00.201967 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-581bdffc-2f3c-4fe4-9e5d-233fa8639514 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:00.202394 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-581bdffc-2f3c-4fe4-9e5d-233fa8639514 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:00.204986 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:00.302961 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a349e51a-d41b-4469-bb68-28ac7d2ea9a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:00.303675 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a349e51a-d41b-4469-bb68-28ac7d2ea9a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:00.310422 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a349e51a-d41b-4469-bb68-28ac7d2ea9a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:00.310888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a349e51a-d41b-4469-bb68-28ac7d2ea9a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:00.311641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a349e51a-d41b-4469-bb68-28ac7d2ea9a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:00.312094 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a349e51a-d41b-4469-bb68-28ac7d2ea9a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:00.331854 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-581bdffc-2f3c-4fe4-9e5d-233fa8639514 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:00.339269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-581bdffc-2f3c-4fe4-9e5d-233fa8639514 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1319 microversion: 2.1 time: 0.150035 Jun 15 15:54:00.339832 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 222/456] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:00 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:00.440237 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a349e51a-d41b-4469-bb68-28ac7d2ea9a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:00.447644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a349e51a-d41b-4469-bb68-28ac7d2ea9a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.149966 Jun 15 15:54:00.448198 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 235/457] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:00 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:01.356165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b48a6f0e-b315-4ce5-b157-d78cdb64b309 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:01.356675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b48a6f0e-b315-4ce5-b157-d78cdb64b309 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:01.363216 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b48a6f0e-b315-4ce5-b157-d78cdb64b309 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:01.363666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b48a6f0e-b315-4ce5-b157-d78cdb64b309 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:01.364426 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b48a6f0e-b315-4ce5-b157-d78cdb64b309 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:01.365363 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b48a6f0e-b315-4ce5-b157-d78cdb64b309 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:01.466231 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-32d3f99a-bce7-4d87-9c8a-95c20bb0a0ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:01.466912 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-32d3f99a-bce7-4d87-9c8a-95c20bb0a0ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:01.473676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-32d3f99a-bce7-4d87-9c8a-95c20bb0a0ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:01.474128 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-32d3f99a-bce7-4d87-9c8a-95c20bb0a0ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:01.474959 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-32d3f99a-bce7-4d87-9c8a-95c20bb0a0ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:01.475391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-32d3f99a-bce7-4d87-9c8a-95c20bb0a0ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:01.494193 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b48a6f0e-b315-4ce5-b157-d78cdb64b309 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:01.501683 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b48a6f0e-b315-4ce5-b157-d78cdb64b309 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1319 microversion: 2.1 time: 0.149496 Jun 15 15:54:01.502361 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 223/458] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:01 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:01.603369 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-32d3f99a-bce7-4d87-9c8a-95c20bb0a0ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:01.610881 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-32d3f99a-bce7-4d87-9c8a-95c20bb0a0ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.150349 Jun 15 15:54:01.611396 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 236/459] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:01 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:02.519237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1d69a8ba-7729-4771-945d-15ca17a776d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:02.519846 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1d69a8ba-7729-4771-945d-15ca17a776d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:02.526939 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d69a8ba-7729-4771-945d-15ca17a776d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:02.527392 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d69a8ba-7729-4771-945d-15ca17a776d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:02.528154 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d69a8ba-7729-4771-945d-15ca17a776d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:02.528590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d69a8ba-7729-4771-945d-15ca17a776d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:02.627762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dd6c4683-6a7f-49a4-b027-fef1dc077331 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:02.628371 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-dd6c4683-6a7f-49a4-b027-fef1dc077331 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:02.635386 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dd6c4683-6a7f-49a4-b027-fef1dc077331 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:02.635832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dd6c4683-6a7f-49a4-b027-fef1dc077331 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:02.636598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dd6c4683-6a7f-49a4-b027-fef1dc077331 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:02.637032 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dd6c4683-6a7f-49a4-b027-fef1dc077331 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:02.654331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1d69a8ba-7729-4771-945d-15ca17a776d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:02.661694 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1d69a8ba-7729-4771-945d-15ca17a776d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1319 microversion: 2.1 time: 0.146325 Jun 15 15:54:02.662511 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 224/460] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:02 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:02.762800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dd6c4683-6a7f-49a4-b027-fef1dc077331 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:02.770137 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-dd6c4683-6a7f-49a4-b027-fef1dc077331 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.146157 Jun 15 15:54:02.770695 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 237/461] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:02 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:03.679975 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9703cdeb-0b1e-414f-a705-5f9896c11e6c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:03.680683 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9703cdeb-0b1e-414f-a705-5f9896c11e6c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:03.688071 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9703cdeb-0b1e-414f-a705-5f9896c11e6c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:03.688662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9703cdeb-0b1e-414f-a705-5f9896c11e6c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:03.689568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9703cdeb-0b1e-414f-a705-5f9896c11e6c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:03.689998 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9703cdeb-0b1e-414f-a705-5f9896c11e6c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:03.788165 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-212dfb28-f43b-410f-bd2a-d34643a05be2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:03.788770 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-212dfb28-f43b-410f-bd2a-d34643a05be2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:03.795213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-212dfb28-f43b-410f-bd2a-d34643a05be2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:03.795665 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-212dfb28-f43b-410f-bd2a-d34643a05be2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:03.796422 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-212dfb28-f43b-410f-bd2a-d34643a05be2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:03.796852 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-212dfb28-f43b-410f-bd2a-d34643a05be2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:03.824732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9703cdeb-0b1e-414f-a705-5f9896c11e6c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:03.832174 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9703cdeb-0b1e-414f-a705-5f9896c11e6c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1319 microversion: 2.1 time: 0.156258 Jun 15 15:54:03.832736 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 225/462] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:03 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:03.923429 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-212dfb28-f43b-410f-bd2a-d34643a05be2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:03.930703 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-212dfb28-f43b-410f-bd2a-d34643a05be2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.147233 Jun 15 15:54:03.931276 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 238/463] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:03 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:04.850145 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c50d9470-c19e-47cb-b1e7-3d992436a0e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:04.850705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c50d9470-c19e-47cb-b1e7-3d992436a0e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:04.857130 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c50d9470-c19e-47cb-b1e7-3d992436a0e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:04.857571 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c50d9470-c19e-47cb-b1e7-3d992436a0e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:04.858314 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c50d9470-c19e-47cb-b1e7-3d992436a0e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:04.858754 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c50d9470-c19e-47cb-b1e7-3d992436a0e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:04.947055 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9a38a827-7216-4287-a985-9733efd2f901 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:04.947742 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9a38a827-7216-4287-a985-9733efd2f901 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:04.954306 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9a38a827-7216-4287-a985-9733efd2f901 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:04.954880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9a38a827-7216-4287-a985-9733efd2f901 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:04.955722 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9a38a827-7216-4287-a985-9733efd2f901 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:04.956250 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9a38a827-7216-4287-a985-9733efd2f901 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:04.991850 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c50d9470-c19e-47cb-b1e7-3d992436a0e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:04.999853 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c50d9470-c19e-47cb-b1e7-3d992436a0e4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1319 microversion: 2.1 time: 0.154162 Jun 15 15:54:05.000425 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 226/464] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:04 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:05.085843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-9a38a827-7216-4287-a985-9733efd2f901 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:05.093253 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9a38a827-7216-4287-a985-9733efd2f901 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1370 microversion: 2.1 time: 0.149865 Jun 15 15:54:05.093816 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 239/465] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:04 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:06.016497 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0d52154a-d84d-4b7e-a876-24546e2a5be4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:06.017140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0d52154a-d84d-4b7e-a876-24546e2a5be4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:06.023492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0d52154a-d84d-4b7e-a876-24546e2a5be4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:06.023942 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0d52154a-d84d-4b7e-a876-24546e2a5be4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:06.024702 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0d52154a-d84d-4b7e-a876-24546e2a5be4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:06.025136 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0d52154a-d84d-4b7e-a876-24546e2a5be4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:06.118939 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-20071ffb-feaf-4010-a6cb-db8888e67253 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:06.118939 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-20071ffb-feaf-4010-a6cb-db8888e67253 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:06.118939 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:06.118939 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=8 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:06.126010 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20071ffb-feaf-4010-a6cb-db8888e67253 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:06.126664 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20071ffb-feaf-4010-a6cb-db8888e67253 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:06.127542 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20071ffb-feaf-4010-a6cb-db8888e67253 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:06.128070 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20071ffb-feaf-4010-a6cb-db8888e67253 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:06.159595 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0d52154a-d84d-4b7e-a876-24546e2a5be4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:06.167858 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0d52154a-d84d-4b7e-a876-24546e2a5be4 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1319 microversion: 2.1 time: 0.155285 Jun 15 15:54:06.168413 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 227/466] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:06 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:06.258806 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-20071ffb-feaf-4010-a6cb-db8888e67253 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:06.266423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-20071ffb-feaf-4010-a6cb-db8888e67253 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1564 microversion: 2.1 time: 0.159952 Jun 15 15:54:06.267080 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 240/467] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:06 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:06.284307 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-68f69230-31a6-4330-9a6d-4cec84db5ba7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:06.284955 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-68f69230-31a6-4330-9a6d-4cec84db5ba7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:06.292825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-68f69230-31a6-4330-9a6d-4cec84db5ba7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:06.293763 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-68f69230-31a6-4330-9a6d-4cec84db5ba7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:06.294692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-68f69230-31a6-4330-9a6d-4cec84db5ba7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:06.295150 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-68f69230-31a6-4330-9a6d-4cec84db5ba7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:06.370534 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-68f69230-31a6-4330-9a6d-4cec84db5ba7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090535 Jun 15 15:54:06.371153 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 228/468] 10.222.0.62 () {58 vars in 1274 bytes} [Wed Jun 15 15:54:06 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:54:07.185594 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ce961aab-ef45-4cd8-b6fc-fae34bfdd5e8 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:07.186294 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ce961aab-ef45-4cd8-b6fc-fae34bfdd5e8 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:07.198239 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ce961aab-ef45-4cd8-b6fc-fae34bfdd5e8 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:07.199654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ce961aab-ef45-4cd8-b6fc-fae34bfdd5e8 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:07.200622 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ce961aab-ef45-4cd8-b6fc-fae34bfdd5e8 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:07.201100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ce961aab-ef45-4cd8-b6fc-fae34bfdd5e8 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:07.472161 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ce961aab-ef45-4cd8-b6fc-fae34bfdd5e8 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:07.484647 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ce961aab-ef45-4cd8-b6fc-fae34bfdd5e8 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1319 microversion: 2.1 time: 0.304317 Jun 15 15:54:07.494509 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 241/469] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:07 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:07.519596 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-a5ad0d19-87a4-4948-9f6e-dd2e2cc3167c req-f61b21e6-3c91-43f6-9567-0d0e18c604f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca2bc05-4595-4e21-8291-04ab2e2d8969", "name": "network-vif-plugged", "status": "completed", "tag": "9503184b-fdbc-4d44-acd4-a547060db68b"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:07.529758 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-a5ad0d19-87a4-4948-9f6e-dd2e2cc3167c req-f61b21e6-3c91-43f6-9567-0d0e18c604f0 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:07.530622 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-a5ad0d19-87a4-4948-9f6e-dd2e2cc3167c req-f61b21e6-3c91-43f6-9567-0d0e18c604f0 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:07.545410 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-a5ad0d19-87a4-4948-9f6e-dd2e2cc3167c req-f61b21e6-3c91-43f6-9567-0d0e18c604f0 service nova] Creating event network-vif-plugged:9503184b-fdbc-4d44-acd4-a547060db68b for instance 3ca2bc05-4595-4e21-8291-04ab2e2d8969 on hv-cinder-84599 Jun 15 15:54:07.551990 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-a5ad0d19-87a4-4948-9f6e-dd2e2cc3167c req-f61b21e6-3c91-43f6-9567-0d0e18c604f0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036988 Jun 15 15:54:07.553921 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 229/470] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:54:07.634823 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-17368013-0d8f-4082-be30-56c298a5f052 req-8287fc94-af2f-4882-8e53-f09f0f8aed6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76bb4599-da4d-40fb-8de1-12edf17a8384", "tag": "a4dbc8ca-933e-46fd-9b4c-8dc00d37465e"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:07.643173 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-17368013-0d8f-4082-be30-56c298a5f052 req-8287fc94-af2f-4882-8e53-f09f0f8aed6b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:07.643617 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-17368013-0d8f-4082-be30-56c298a5f052 req-8287fc94-af2f-4882-8e53-f09f0f8aed6b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:07.655649 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-17368013-0d8f-4082-be30-56c298a5f052 req-8287fc94-af2f-4882-8e53-f09f0f8aed6b service nova] Creating event network-changed:a4dbc8ca-933e-46fd-9b4c-8dc00d37465e for instance 76bb4599-da4d-40fb-8de1-12edf17a8384 on hv-cinder-84599 Jun 15 15:54:07.660640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-17368013-0d8f-4082-be30-56c298a5f052 req-8287fc94-af2f-4882-8e53-f09f0f8aed6b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030765 Jun 15 15:54:07.661509 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 242/471] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:54:08.350665 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e9422e6a-016c-4246-835f-75acb66356e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:08.360430 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e9422e6a-016c-4246-835f-75acb66356e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:08.360879 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e9422e6a-016c-4246-835f-75acb66356e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:08.423203 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e9422e6a-016c-4246-835f-75acb66356e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Going to try to stop instance {{(pid=123935) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 15:54:08.486626 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e9422e6a-016c-4246-835f-75acb66356e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "POST /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/action" status: 202 len: 0 microversion: 2.1 time: 0.140999 Jun 15 15:54:08.487273 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 230/472] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 15:54:08 2022] POST /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:54:08.498684 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4b55c813-f553-4ca2-b742-52a4f1281d1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:08.499496 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4b55c813-f553-4ca2-b742-52a4f1281d1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:08.506751 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4b55c813-f553-4ca2-b742-52a4f1281d1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:08.507340 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4b55c813-f553-4ca2-b742-52a4f1281d1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:08.508218 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4b55c813-f553-4ca2-b742-52a4f1281d1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:08.508718 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4b55c813-f553-4ca2-b742-52a4f1281d1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:08.509724 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d8ceca84-11ab-464e-933d-ed37b89f8ad3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:08.510431 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d8ceca84-11ab-464e-933d-ed37b89f8ad3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:08.517140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8ceca84-11ab-464e-933d-ed37b89f8ad3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:08.518225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8ceca84-11ab-464e-933d-ed37b89f8ad3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:08.519043 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8ceca84-11ab-464e-933d-ed37b89f8ad3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:08.519482 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8ceca84-11ab-464e-933d-ed37b89f8ad3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:08.724496 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4b55c813-f553-4ca2-b742-52a4f1281d1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:08.726434 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d8ceca84-11ab-464e-933d-ed37b89f8ad3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:08.733334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4b55c813-f553-4ca2-b742-52a4f1281d1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.241489 Jun 15 15:54:08.733963 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 243/473] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:08 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:08.734253 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d8ceca84-11ab-464e-933d-ed37b89f8ad3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1319 microversion: 2.1 time: 0.230254 Jun 15 15:54:08.734971 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 231/474] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:08 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:09.750746 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2a9bd5da-d6f7-44fb-83cb-72d5194daab3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:09.751618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7c52ffd4-4463-4798-b946-3aa9c64209fa tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:09.752162 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2a9bd5da-d6f7-44fb-83cb-72d5194daab3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:09.752557 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7c52ffd4-4463-4798-b946-3aa9c64209fa tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:09.760206 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c52ffd4-4463-4798-b946-3aa9c64209fa tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:09.760206 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c52ffd4-4463-4798-b946-3aa9c64209fa tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:09.761174 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c52ffd4-4463-4798-b946-3aa9c64209fa tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:09.761174 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c52ffd4-4463-4798-b946-3aa9c64209fa tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:09.762085 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a9bd5da-d6f7-44fb-83cb-72d5194daab3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:09.762598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a9bd5da-d6f7-44fb-83cb-72d5194daab3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:09.764844 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a9bd5da-d6f7-44fb-83cb-72d5194daab3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:09.765295 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a9bd5da-d6f7-44fb-83cb-72d5194daab3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:09.952906 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7c52ffd4-4463-4798-b946-3aa9c64209fa tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:09.960774 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7c52ffd4-4463-4798-b946-3aa9c64209fa tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.213973 Jun 15 15:54:09.961335 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 244/475] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:09 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:09.966056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2a9bd5da-d6f7-44fb-83cb-72d5194daab3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:09.973545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2a9bd5da-d6f7-44fb-83cb-72d5194daab3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1319 microversion: 2.1 time: 0.226756 Jun 15 15:54:09.974598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 232/476] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:09 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:10.978129 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d1489042-2091-4bad-9ea0-d9fe1de15051 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:10.978669 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d1489042-2091-4bad-9ea0-d9fe1de15051 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:10.985141 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1489042-2091-4bad-9ea0-d9fe1de15051 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:10.985585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1489042-2091-4bad-9ea0-d9fe1de15051 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:10.986353 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1489042-2091-4bad-9ea0-d9fe1de15051 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:10.986823 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d1489042-2091-4bad-9ea0-d9fe1de15051 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:10.990204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c455dacd-bdfa-41ab-9824-f8e32373122b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:10.990828 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c455dacd-bdfa-41ab-9824-f8e32373122b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:10.997496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c455dacd-bdfa-41ab-9824-f8e32373122b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:10.997932 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c455dacd-bdfa-41ab-9824-f8e32373122b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:10.998677 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c455dacd-bdfa-41ab-9824-f8e32373122b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:10.999121 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c455dacd-bdfa-41ab-9824-f8e32373122b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:11.187657 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d1489042-2091-4bad-9ea0-d9fe1de15051 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:11.190852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c455dacd-bdfa-41ab-9824-f8e32373122b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:11.196270 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d1489042-2091-4bad-9ea0-d9fe1de15051 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.222015 Jun 15 15:54:11.196931 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 245/477] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:10 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:11.198870 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c455dacd-bdfa-41ab-9824-f8e32373122b tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1506 microversion: 2.1 time: 0.212932 Jun 15 15:54:11.199428 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 233/478] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:10 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:11.215546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-93d556a8-631a-4cc9-aeb8-ddeccb1bbb0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67613564-ff22-4134-a674-8fe60c226c86", "device": "/dev/sdb"}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:11.217167 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-93d556a8-631a-4cc9-aeb8-ddeccb1bbb0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:11.223056 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-93d556a8-631a-4cc9-aeb8-ddeccb1bbb0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:11.223491 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-93d556a8-631a-4cc9-aeb8-ddeccb1bbb0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:11.224841 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-93d556a8-631a-4cc9-aeb8-ddeccb1bbb0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:11.225266 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-93d556a8-631a-4cc9-aeb8-ddeccb1bbb0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:12.161663 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:12.213550 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a1e941bf-f52c-49b0-9a9c-9fcb4b43b64a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:12.214141 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a1e941bf-f52c-49b0-9a9c-9fcb4b43b64a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:12.221440 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a1e941bf-f52c-49b0-9a9c-9fcb4b43b64a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:12.222669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a1e941bf-f52c-49b0-9a9c-9fcb4b43b64a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:12.224492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a1e941bf-f52c-49b0-9a9c-9fcb4b43b64a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:12.225165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a1e941bf-f52c-49b0-9a9c-9fcb4b43b64a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:12.275691 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-93d556a8-631a-4cc9-aeb8-ddeccb1bbb0e tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "POST /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.063749 Jun 15 15:54:12.276672 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 246/479] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 15:54:11 2022] POST /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969/os-volume_attachments => generated 194 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:54:12.374502 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a1e941bf-f52c-49b0-9a9c-9fcb4b43b64a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:12.382528 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a1e941bf-f52c-49b0-9a9c-9fcb4b43b64a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.172975 Jun 15 15:54:12.383140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 234/480] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:12 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:12.745889 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a9e7fea1-7150-452e-9f36-6b70f6672865 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: .version_select at 0x7fd8d8444160>, body: {"keypair": {"name": "tempest-keypair-1825631026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDbpgGx5OXss3abxRDjOEz48uUCXNpoX8cLyynUmlTamqX/LnBvujTsNv/i4F2/qJGGaaJqdDBpY95sgWKBjna6vmxhvvYv1q/txQRO8/HZC6/wc3ladCbqRCMM7WGlzw=="}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:12.759122 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-a9e7fea1-7150-452e-9f36-6b70f6672865 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for project 0496c4ee9cdf486684000904876d0b6b. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:54:12.762678 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-a9e7fea1-7150-452e-9f36-6b70f6672865 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for user fb838f931b7748e2baf6c2315d3cbd75 and project 0496c4ee9cdf486684000904876d0b6b. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:54:12.783769 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a9e7fea1-7150-452e-9f36-6b70f6672865 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043104 Jun 15 15:54:12.784380 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 247/481] 10.222.0.62 () {60 vars in 1158 bytes} [Wed Jun 15 15:54:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:54:13.311250 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7e3e3f04-bab0-4096-b7b2-fdc3a066ff3b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:13.311777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7e3e3f04-bab0-4096-b7b2-fdc3a066ff3b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:13.318137 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e3e3f04-bab0-4096-b7b2-fdc3a066ff3b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:13.318583 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e3e3f04-bab0-4096-b7b2-fdc3a066ff3b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:13.319479 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e3e3f04-bab0-4096-b7b2-fdc3a066ff3b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:13.319910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e3e3f04-bab0-4096-b7b2-fdc3a066ff3b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:13.343223 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7e3e3f04-bab0-4096-b7b2-fdc3a066ff3b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/ips" status: 200 len: 150 microversion: 2.20 time: 0.035952 Jun 15 15:54:13.349415 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 235/482] 10.222.0.62 () {60 vars in 1288 bytes} [Wed Jun 15 15:54:13 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:54:13.400247 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-aa2e06ee-627f-4e77-9800-7a1a8d0806b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:13.401101 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-aa2e06ee-627f-4e77-9800-7a1a8d0806b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:13.410793 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa2e06ee-627f-4e77-9800-7a1a8d0806b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:13.412197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa2e06ee-627f-4e77-9800-7a1a8d0806b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:13.413084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa2e06ee-627f-4e77-9800-7a1a8d0806b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:13.413587 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa2e06ee-627f-4e77-9800-7a1a8d0806b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:13.560715 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-aa2e06ee-627f-4e77-9800-7a1a8d0806b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:13.569724 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-aa2e06ee-627f-4e77-9800-7a1a8d0806b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.174248 Jun 15 15:54:13.570977 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 248/483] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:13 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:14.090721 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1271599146", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "597f7e5d-558d-4aed-88e5-ecbc7c009bb7"}], "security_groups": [{"name": "tempest-securitygroup--475223661"}], "key_name": "tempest-keypair-1825631026", "user_data": "}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:14.188235 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] validate_networks() for [('597f7e5d-558d-4aed-88e5-ecbc7c009bb7', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:54:14.551475 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:54:14.552058 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:54:14.552337 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:54:14.552735 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:54:14.553135 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:54:14.561694 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:14.562130 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:14.562949 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:14.563380 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:14.579940 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for project 0496c4ee9cdf486684000904876d0b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:54:14.584384 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for user fb838f931b7748e2baf6c2315d3cbd75 and project 0496c4ee9cdf486684000904876d0b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:54:14.588084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b21682d8-3b2e-4b45-9bf0-22723cd0442c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:14.588693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b21682d8-3b2e-4b45-9bf0-22723cd0442c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:14.595144 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b21682d8-3b2e-4b45-9bf0-22723cd0442c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:14.595442 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:54:14.595596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b21682d8-3b2e-4b45-9bf0-22723cd0442c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:14.596368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b21682d8-3b2e-4b45-9bf0-22723cd0442c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:14.596792 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b21682d8-3b2e-4b45-9bf0-22723cd0442c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:14.597685 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:54:14.646445 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-228559ca-ba8b-4f4a-9e39-690316972535 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.559290 Jun 15 15:54:14.647331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 236/484] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:54:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:54:14.656855 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0091a751-fbc2-441a-8ccc-a0fc39c6bd03 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:14.657472 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0091a751-fbc2-441a-8ccc-a0fc39c6bd03 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:14.726386 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0091a751-fbc2-441a-8ccc-a0fc39c6bd03 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:14.734877 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0091a751-fbc2-441a-8ccc-a0fc39c6bd03 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1242 microversion: 2.1 time: 0.081635 Jun 15 15:54:14.735617 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 237/485] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:14 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:14.759699 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b21682d8-3b2e-4b45-9bf0-22723cd0442c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:14.768475 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b21682d8-3b2e-4b45-9bf0-22723cd0442c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.184196 Jun 15 15:54:14.769065 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 249/486] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:14 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:15.752226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3a5666df-eb3f-4151-888d-ce023aa1318c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:15.753421 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3a5666df-eb3f-4151-888d-ce023aa1318c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:15.760892 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3a5666df-eb3f-4151-888d-ce023aa1318c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:15.761564 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3a5666df-eb3f-4151-888d-ce023aa1318c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:15.762700 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3a5666df-eb3f-4151-888d-ce023aa1318c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:15.763304 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3a5666df-eb3f-4151-888d-ce023aa1318c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:15.785461 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cadd109d-f532-423a-8a45-34f2f630aefd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:15.788152 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-cadd109d-f532-423a-8a45-34f2f630aefd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:15.795042 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cadd109d-f532-423a-8a45-34f2f630aefd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:15.795932 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cadd109d-f532-423a-8a45-34f2f630aefd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:15.796493 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cadd109d-f532-423a-8a45-34f2f630aefd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:15.797177 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cadd109d-f532-423a-8a45-34f2f630aefd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:15.843269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3a5666df-eb3f-4151-888d-ce023aa1318c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:15.852008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3a5666df-eb3f-4151-888d-ce023aa1318c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1302 microversion: 2.1 time: 0.103803 Jun 15 15:54:15.861786 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 238/487] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:15 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1302 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:15.960335 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cadd109d-f532-423a-8a45-34f2f630aefd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:15.969492 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-cadd109d-f532-423a-8a45-34f2f630aefd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.188054 Jun 15 15:54:15.970056 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 250/488] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:15 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:16.341226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-798a9d2e-c4cb-416b-b7c8-814a868421d8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:16.341669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-798a9d2e-c4cb-416b-b7c8-814a868421d8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:16.347863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-798a9d2e-c4cb-416b-b7c8-814a868421d8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:16.348304 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-798a9d2e-c4cb-416b-b7c8-814a868421d8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:16.349058 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-798a9d2e-c4cb-416b-b7c8-814a868421d8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:16.349480 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-798a9d2e-c4cb-416b-b7c8-814a868421d8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:16.372984 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-798a9d2e-c4cb-416b-b7c8-814a868421d8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lazy-loading 'flavor' on Instance uuid c8ff33fe-05bf-4bd5-9159-69805bae0aed {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:54:16.413700 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:16.649834 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-798a9d2e-c4cb-416b-b7c8-814a868421d8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/action" status: 202 len: 0 microversion: 2.20 time: 0.312464 Jun 15 15:54:16.653782 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 239/489] 10.222.0.62 () {62 vars in 1318 bytes} [Wed Jun 15 15:54:16 2022] POST /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:54:16.659953 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-62dc2ec3-3a33-484d-858a-59af1bc492b2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:16.660603 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-62dc2ec3-3a33-484d-858a-59af1bc492b2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:16.668186 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-62dc2ec3-3a33-484d-858a-59af1bc492b2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:16.668714 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-62dc2ec3-3a33-484d-858a-59af1bc492b2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:16.669631 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-62dc2ec3-3a33-484d-858a-59af1bc492b2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:16.670167 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-62dc2ec3-3a33-484d-858a-59af1bc492b2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:16.803635 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-62dc2ec3-3a33-484d-858a-59af1bc492b2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:16.811933 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-62dc2ec3-3a33-484d-858a-59af1bc492b2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:16.813444 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-62dc2ec3-3a33-484d-858a-59af1bc492b2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:16.814788 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-62dc2ec3-3a33-484d-858a-59af1bc492b2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.159498 Jun 15 15:54:16.815322 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 251/490] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:16 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:16.871262 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-57581cde-b9a7-494f-8266-6c79a44aeb1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:16.872541 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-57581cde-b9a7-494f-8266-6c79a44aeb1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:16.879547 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-57581cde-b9a7-494f-8266-6c79a44aeb1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:16.880154 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-57581cde-b9a7-494f-8266-6c79a44aeb1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:16.880919 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-57581cde-b9a7-494f-8266-6c79a44aeb1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:16.881341 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-57581cde-b9a7-494f-8266-6c79a44aeb1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:16.986416 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4bcc1476-cc32-4cbb-bb03-eaac581a67d2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:16.987432 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4bcc1476-cc32-4cbb-bb03-eaac581a67d2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:16.994350 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4bcc1476-cc32-4cbb-bb03-eaac581a67d2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:16.995049 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4bcc1476-cc32-4cbb-bb03-eaac581a67d2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:16.996071 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4bcc1476-cc32-4cbb-bb03-eaac581a67d2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:16.996672 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4bcc1476-cc32-4cbb-bb03-eaac581a67d2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:17.034360 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-57581cde-b9a7-494f-8266-6c79a44aeb1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:17.042899 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-57581cde-b9a7-494f-8266-6c79a44aeb1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.176507 Jun 15 15:54:17.043790 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 240/491] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:16 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:17.144296 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4bcc1476-cc32-4cbb-bb03-eaac581a67d2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:17.153946 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4bcc1476-cc32-4cbb-bb03-eaac581a67d2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.171163 Jun 15 15:54:17.154583 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 252/492] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:16 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:17.589041 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-c6cd8963-7d1a-413c-aaad-ced54ef45463 req-ee6e2d47-e4f8-4122-98ba-91245cd9122e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3418e7-7db0-4525-93e2-9646dde34b8b", "tag": "61559de7-75c9-4a3b-a009-2e5b844c72b0"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:17.614226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-c6cd8963-7d1a-413c-aaad-ced54ef45463 req-ee6e2d47-e4f8-4122-98ba-91245cd9122e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:17.614681 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-c6cd8963-7d1a-413c-aaad-ced54ef45463 req-ee6e2d47-e4f8-4122-98ba-91245cd9122e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:17.640823 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-c6cd8963-7d1a-413c-aaad-ced54ef45463 req-ee6e2d47-e4f8-4122-98ba-91245cd9122e service nova] Creating event network-changed:61559de7-75c9-4a3b-a009-2e5b844c72b0 for instance 4e3418e7-7db0-4525-93e2-9646dde34b8b on hv-cinder-84599 Jun 15 15:54:17.646311 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-c6cd8963-7d1a-413c-aaad-ced54ef45463 req-ee6e2d47-e4f8-4122-98ba-91245cd9122e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061226 Jun 15 15:54:17.647064 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 241/493] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:54:17.833307 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b1419743-7948-41be-947d-4e0f2c91d9b7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:17.837439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b1419743-7948-41be-947d-4e0f2c91d9b7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:17.846842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1419743-7948-41be-947d-4e0f2c91d9b7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:17.847564 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1419743-7948-41be-947d-4e0f2c91d9b7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:17.848645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1419743-7948-41be-947d-4e0f2c91d9b7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:17.849102 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1419743-7948-41be-947d-4e0f2c91d9b7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:17.987485 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b1419743-7948-41be-947d-4e0f2c91d9b7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:17.995887 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b1419743-7948-41be-947d-4e0f2c91d9b7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:17.997364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b1419743-7948-41be-947d-4e0f2c91d9b7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:17.998529 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b1419743-7948-41be-947d-4e0f2c91d9b7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.169116 Jun 15 15:54:17.999108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 253/494] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:17 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:18.060914 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fe0769ff-f094-4fe5-951d-1063ff2f096b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:18.061693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fe0769ff-f094-4fe5-951d-1063ff2f096b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:18.068522 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fe0769ff-f094-4fe5-951d-1063ff2f096b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:18.068957 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fe0769ff-f094-4fe5-951d-1063ff2f096b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:18.069708 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fe0769ff-f094-4fe5-951d-1063ff2f096b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:18.070134 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fe0769ff-f094-4fe5-951d-1063ff2f096b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:18.176060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3da4da63-70f3-40bc-a5e7-767be077d2d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:18.177182 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3da4da63-70f3-40bc-a5e7-767be077d2d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:18.183102 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3da4da63-70f3-40bc-a5e7-767be077d2d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:18.183545 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3da4da63-70f3-40bc-a5e7-767be077d2d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:18.184307 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3da4da63-70f3-40bc-a5e7-767be077d2d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:18.184738 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3da4da63-70f3-40bc-a5e7-767be077d2d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:18.197335 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fe0769ff-f094-4fe5-951d-1063ff2f096b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:18.204858 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fe0769ff-f094-4fe5-951d-1063ff2f096b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.148555 Jun 15 15:54:18.205667 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 242/495] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:18 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:18.312377 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3da4da63-70f3-40bc-a5e7-767be077d2d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:18.320197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3da4da63-70f3-40bc-a5e7-767be077d2d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.148087 Jun 15 15:54:18.320756 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 254/496] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:18 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:19.017305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3b25071c-a27c-4f49-88f9-a8b6d90c8cf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:19.017840 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3b25071c-a27c-4f49-88f9-a8b6d90c8cf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:19.023919 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b25071c-a27c-4f49-88f9-a8b6d90c8cf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:19.024375 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b25071c-a27c-4f49-88f9-a8b6d90c8cf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:19.025158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b25071c-a27c-4f49-88f9-a8b6d90c8cf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:19.025595 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b25071c-a27c-4f49-88f9-a8b6d90c8cf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:19.153717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3b25071c-a27c-4f49-88f9-a8b6d90c8cf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:19.162321 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3b25071c-a27c-4f49-88f9-a8b6d90c8cf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:19.163881 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3b25071c-a27c-4f49-88f9-a8b6d90c8cf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:19.165300 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3b25071c-a27c-4f49-88f9-a8b6d90c8cf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.151710 Jun 15 15:54:19.165807 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 243/497] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:19 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:19.221401 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2cf6ee98-e63f-4139-9bec-f139c447acbc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:19.222009 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2cf6ee98-e63f-4139-9bec-f139c447acbc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:19.229030 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2cf6ee98-e63f-4139-9bec-f139c447acbc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:19.229477 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2cf6ee98-e63f-4139-9bec-f139c447acbc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:19.230243 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2cf6ee98-e63f-4139-9bec-f139c447acbc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:19.230675 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2cf6ee98-e63f-4139-9bec-f139c447acbc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:19.337680 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4ab9be8f-45de-471f-9e5f-82a471b7e02c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:19.338283 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4ab9be8f-45de-471f-9e5f-82a471b7e02c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:19.344166 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4ab9be8f-45de-471f-9e5f-82a471b7e02c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:19.344604 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4ab9be8f-45de-471f-9e5f-82a471b7e02c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:19.345350 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4ab9be8f-45de-471f-9e5f-82a471b7e02c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:19.345775 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4ab9be8f-45de-471f-9e5f-82a471b7e02c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:19.359288 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2cf6ee98-e63f-4139-9bec-f139c447acbc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:19.366710 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2cf6ee98-e63f-4139-9bec-f139c447acbc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.149199 Jun 15 15:54:19.367449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 255/498] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:19 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:19.481609 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4ab9be8f-45de-471f-9e5f-82a471b7e02c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:19.489362 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4ab9be8f-45de-471f-9e5f-82a471b7e02c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.155527 Jun 15 15:54:19.489908 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 244/499] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:19 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:20.183633 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f5b3d931-057c-44cb-81ee-d110bdf6c870 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:20.184246 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f5b3d931-057c-44cb-81ee-d110bdf6c870 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:20.190203 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f5b3d931-057c-44cb-81ee-d110bdf6c870 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:20.190645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f5b3d931-057c-44cb-81ee-d110bdf6c870 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:20.191430 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f5b3d931-057c-44cb-81ee-d110bdf6c870 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:20.191865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f5b3d931-057c-44cb-81ee-d110bdf6c870 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:20.319909 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f5b3d931-057c-44cb-81ee-d110bdf6c870 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:20.327671 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f5b3d931-057c-44cb-81ee-d110bdf6c870 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:20.329168 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f5b3d931-057c-44cb-81ee-d110bdf6c870 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:20.330302 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f5b3d931-057c-44cb-81ee-d110bdf6c870 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.150629 Jun 15 15:54:20.330907 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 256/500] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:20 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:20.383331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e642ffd0-0416-441a-8610-9152fdbd8ba3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:20.383942 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e642ffd0-0416-441a-8610-9152fdbd8ba3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:20.390461 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e642ffd0-0416-441a-8610-9152fdbd8ba3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:20.390948 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e642ffd0-0416-441a-8610-9152fdbd8ba3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:20.391715 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e642ffd0-0416-441a-8610-9152fdbd8ba3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:20.392147 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e642ffd0-0416-441a-8610-9152fdbd8ba3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:20.506785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d335a145-1c6a-4299-8090-dec33dcbb6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:20.507439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d335a145-1c6a-4299-8090-dec33dcbb6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:20.513381 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d335a145-1c6a-4299-8090-dec33dcbb6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:20.513832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d335a145-1c6a-4299-8090-dec33dcbb6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:20.514596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d335a145-1c6a-4299-8090-dec33dcbb6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:20.515064 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d335a145-1c6a-4299-8090-dec33dcbb6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:20.523991 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e642ffd0-0416-441a-8610-9152fdbd8ba3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:20.531639 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e642ffd0-0416-441a-8610-9152fdbd8ba3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.152089 Jun 15 15:54:20.532202 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 245/501] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:20 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:20.638657 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d335a145-1c6a-4299-8090-dec33dcbb6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:20.646491 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d335a145-1c6a-4299-8090-dec33dcbb6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.143823 Jun 15 15:54:20.647095 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 257/502] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:20 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:21.348099 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-61c45b84-863a-4670-b101-495b61627576 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:21.349192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-61c45b84-863a-4670-b101-495b61627576 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:21.355350 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61c45b84-863a-4670-b101-495b61627576 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:21.355799 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61c45b84-863a-4670-b101-495b61627576 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:21.356551 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61c45b84-863a-4670-b101-495b61627576 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:21.356984 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61c45b84-863a-4670-b101-495b61627576 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:21.483374 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-61c45b84-863a-4670-b101-495b61627576 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:21.491361 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-61c45b84-863a-4670-b101-495b61627576 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:21.492901 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-61c45b84-863a-4670-b101-495b61627576 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:21.494046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-61c45b84-863a-4670-b101-495b61627576 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.149877 Jun 15 15:54:21.494598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 246/503] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:21 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:21.550909 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a42d4bc7-565f-4e8a-9eb9-752bd730409d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:21.551518 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a42d4bc7-565f-4e8a-9eb9-752bd730409d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:21.558062 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a42d4bc7-565f-4e8a-9eb9-752bd730409d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:21.558506 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a42d4bc7-565f-4e8a-9eb9-752bd730409d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:21.559310 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a42d4bc7-565f-4e8a-9eb9-752bd730409d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:21.559740 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a42d4bc7-565f-4e8a-9eb9-752bd730409d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:21.664469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7c78bb5a-199a-45ce-aac1-211ab9f28b79 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:21.665084 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7c78bb5a-199a-45ce-aac1-211ab9f28b79 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:21.671072 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c78bb5a-199a-45ce-aac1-211ab9f28b79 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:21.671524 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c78bb5a-199a-45ce-aac1-211ab9f28b79 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:21.672288 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c78bb5a-199a-45ce-aac1-211ab9f28b79 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:21.672724 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c78bb5a-199a-45ce-aac1-211ab9f28b79 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:21.688050 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a42d4bc7-565f-4e8a-9eb9-752bd730409d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:21.695534 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a42d4bc7-565f-4e8a-9eb9-752bd730409d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.148544 Jun 15 15:54:21.696097 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 258/504] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:21 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:21.798243 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7c78bb5a-199a-45ce-aac1-211ab9f28b79 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:21.807337 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7c78bb5a-199a-45ce-aac1-211ab9f28b79 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1723 microversion: 2.1 time: 0.147524 Jun 15 15:54:21.807901 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 247/505] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:21 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:22.513403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-853b1513-5a9d-40eb-baa5-5bce7c3222c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:22.513994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-853b1513-5a9d-40eb-baa5-5bce7c3222c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:22.519943 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-853b1513-5a9d-40eb-baa5-5bce7c3222c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:22.520894 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-853b1513-5a9d-40eb-baa5-5bce7c3222c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:22.521640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-853b1513-5a9d-40eb-baa5-5bce7c3222c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:22.522063 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-853b1513-5a9d-40eb-baa5-5bce7c3222c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:22.651044 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-853b1513-5a9d-40eb-baa5-5bce7c3222c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:22.658801 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-853b1513-5a9d-40eb-baa5-5bce7c3222c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:22.660288 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-853b1513-5a9d-40eb-baa5-5bce7c3222c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:22.661465 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-853b1513-5a9d-40eb-baa5-5bce7c3222c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.152007 Jun 15 15:54:22.662280 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 259/506] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:22 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:22.713009 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d2ced405-73dd-4145-b995-bd57029854aa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:22.713551 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d2ced405-73dd-4145-b995-bd57029854aa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:22.720090 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d2ced405-73dd-4145-b995-bd57029854aa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:22.720536 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d2ced405-73dd-4145-b995-bd57029854aa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:22.721297 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d2ced405-73dd-4145-b995-bd57029854aa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:22.721728 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d2ced405-73dd-4145-b995-bd57029854aa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:22.826628 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a4de2055-c03f-4975-86b8-593a77a8f4de tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:22.827579 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a4de2055-c03f-4975-86b8-593a77a8f4de tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:22.835308 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=4 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:22.837514 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a4de2055-c03f-4975-86b8-593a77a8f4de tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:22.838395 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a4de2055-c03f-4975-86b8-593a77a8f4de tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:22.839771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a4de2055-c03f-4975-86b8-593a77a8f4de tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:22.840382 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a4de2055-c03f-4975-86b8-593a77a8f4de tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:22.862722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d2ced405-73dd-4145-b995-bd57029854aa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:22.870454 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d2ced405-73dd-4145-b995-bd57029854aa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.161283 Jun 15 15:54:22.871480 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 248/507] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:22 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:22.982146 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a4de2055-c03f-4975-86b8-593a77a8f4de tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:22.990504 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a4de2055-c03f-4975-86b8-593a77a8f4de tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1700 microversion: 2.1 time: 0.170280 Jun 15 15:54:22.991103 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 260/508] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:22 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1700 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:23.007455 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8aeeb3e0-0074-4848-949b-c0f127222d8f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:23.013489 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8aeeb3e0-0074-4848-949b-c0f127222d8f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:23.013927 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8aeeb3e0-0074-4848-949b-c0f127222d8f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:23.034706 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-8aeeb3e0-0074-4848-949b-c0f127222d8f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Going to try to start instance {{(pid=123935) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 15:54:23.076128 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-8aeeb3e0-0074-4848-949b-c0f127222d8f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "POST /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/action" status: 202 len: 0 microversion: 2.1 time: 0.073043 Jun 15 15:54:23.076710 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 249/509] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 15:54:23 2022] POST /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:54:23.084854 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4a1cec1f-e70a-493e-bb17-a08260c52e73 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:23.085466 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4a1cec1f-e70a-493e-bb17-a08260c52e73 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:23.091546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a1cec1f-e70a-493e-bb17-a08260c52e73 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:23.092000 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a1cec1f-e70a-493e-bb17-a08260c52e73 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:23.092748 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a1cec1f-e70a-493e-bb17-a08260c52e73 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:23.093179 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a1cec1f-e70a-493e-bb17-a08260c52e73 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:23.222425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4a1cec1f-e70a-493e-bb17-a08260c52e73 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:23.231669 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4a1cec1f-e70a-493e-bb17-a08260c52e73 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1709 microversion: 2.1 time: 0.150675 Jun 15 15:54:23.240933 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 261/510] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:23 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:23.680451 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ccde5cad-b81e-450e-ab68-926ba0e872bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:23.681174 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ccde5cad-b81e-450e-ab68-926ba0e872bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:23.690892 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ccde5cad-b81e-450e-ab68-926ba0e872bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:23.691345 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ccde5cad-b81e-450e-ab68-926ba0e872bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:23.692624 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ccde5cad-b81e-450e-ab68-926ba0e872bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:23.693140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ccde5cad-b81e-450e-ab68-926ba0e872bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:23.889103 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-febdbc79-0adf-43ee-9001-7f803113c453 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:23.889708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-febdbc79-0adf-43ee-9001-7f803113c453 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:23.896392 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-febdbc79-0adf-43ee-9001-7f803113c453 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:23.896845 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-febdbc79-0adf-43ee-9001-7f803113c453 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:23.897606 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-febdbc79-0adf-43ee-9001-7f803113c453 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:23.898035 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-febdbc79-0adf-43ee-9001-7f803113c453 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:23.919290 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ccde5cad-b81e-450e-ab68-926ba0e872bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:23.928948 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ccde5cad-b81e-450e-ab68-926ba0e872bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:23.930461 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ccde5cad-b81e-450e-ab68-926ba0e872bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:23.931649 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ccde5cad-b81e-450e-ab68-926ba0e872bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.255545 Jun 15 15:54:23.943180 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 250/511] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:23 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:24.115848 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-febdbc79-0adf-43ee-9001-7f803113c453 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:24.125976 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-febdbc79-0adf-43ee-9001-7f803113c453 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.240999 Jun 15 15:54:24.126775 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 262/512] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:23 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:24.249421 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-56b62eee-0938-4e2a-866a-ffe7e7d89685 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:24.250058 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-56b62eee-0938-4e2a-866a-ffe7e7d89685 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:24.256062 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-56b62eee-0938-4e2a-866a-ffe7e7d89685 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:24.256510 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-56b62eee-0938-4e2a-866a-ffe7e7d89685 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:24.257274 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-56b62eee-0938-4e2a-866a-ffe7e7d89685 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:24.257706 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-56b62eee-0938-4e2a-866a-ffe7e7d89685 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:24.382381 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-56b62eee-0938-4e2a-866a-ffe7e7d89685 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:24.390246 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-56b62eee-0938-4e2a-866a-ffe7e7d89685 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1709 microversion: 2.1 time: 0.144776 Jun 15 15:54:24.390815 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 251/513] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:24 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1709 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:24.949217 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-fbeb9fd9-9c03-402e-b748-0321a16f96d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:24.949816 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-fbeb9fd9-9c03-402e-b748-0321a16f96d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:24.956244 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fbeb9fd9-9c03-402e-b748-0321a16f96d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:24.956685 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fbeb9fd9-9c03-402e-b748-0321a16f96d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:24.957425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fbeb9fd9-9c03-402e-b748-0321a16f96d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:24.958098 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fbeb9fd9-9c03-402e-b748-0321a16f96d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:25.087080 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fbeb9fd9-9c03-402e-b748-0321a16f96d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:25.089245 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:25.096508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fbeb9fd9-9c03-402e-b748-0321a16f96d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:25.097998 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fbeb9fd9-9c03-402e-b748-0321a16f96d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:25.099675 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fbeb9fd9-9c03-402e-b748-0321a16f96d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.154314 Jun 15 15:54:25.100226 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 263/514] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:24 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:25.142815 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7b46ba52-38fb-4091-b570-4c5b1fe92eed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:25.143417 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7b46ba52-38fb-4091-b570-4c5b1fe92eed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:25.145898 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:25.147277 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=8 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:25.153422 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7b46ba52-38fb-4091-b570-4c5b1fe92eed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:25.153970 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7b46ba52-38fb-4091-b570-4c5b1fe92eed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:25.154704 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7b46ba52-38fb-4091-b570-4c5b1fe92eed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:25.155198 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7b46ba52-38fb-4091-b570-4c5b1fe92eed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:25.281158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7b46ba52-38fb-4091-b570-4c5b1fe92eed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:25.288942 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7b46ba52-38fb-4091-b570-4c5b1fe92eed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.149624 Jun 15 15:54:25.289598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 252/515] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:25 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:25.407827 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0b9a9cd9-b15e-4af0-9154-32e29b8f09ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:25.408438 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0b9a9cd9-b15e-4af0-9154-32e29b8f09ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:25.415538 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0b9a9cd9-b15e-4af0-9154-32e29b8f09ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:25.415986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0b9a9cd9-b15e-4af0-9154-32e29b8f09ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:25.416745 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0b9a9cd9-b15e-4af0-9154-32e29b8f09ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:25.417180 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0b9a9cd9-b15e-4af0-9154-32e29b8f09ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:25.548593 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0b9a9cd9-b15e-4af0-9154-32e29b8f09ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:25.557099 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0b9a9cd9-b15e-4af0-9154-32e29b8f09ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1709 microversion: 2.1 time: 0.153384 Jun 15 15:54:25.557667 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 264/516] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:25 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:26.118330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c5681af1-c58c-4aed-8191-a92f1f7dff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:26.118969 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c5681af1-c58c-4aed-8191-a92f1f7dff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:26.124969 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c5681af1-c58c-4aed-8191-a92f1f7dff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:26.125417 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c5681af1-c58c-4aed-8191-a92f1f7dff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:26.126173 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c5681af1-c58c-4aed-8191-a92f1f7dff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:26.126610 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c5681af1-c58c-4aed-8191-a92f1f7dff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:26.254301 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c5681af1-c58c-4aed-8191-a92f1f7dff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:26.262839 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c5681af1-c58c-4aed-8191-a92f1f7dff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:26.264365 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c5681af1-c58c-4aed-8191-a92f1f7dff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:26.265512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c5681af1-c58c-4aed-8191-a92f1f7dff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.151657 Jun 15 15:54:26.266068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 253/517] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:26 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:26.305689 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e273e7fe-2a5f-4399-b359-f19673e7b66e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:26.306320 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e273e7fe-2a5f-4399-b359-f19673e7b66e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:26.312746 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e273e7fe-2a5f-4399-b359-f19673e7b66e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:26.313187 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e273e7fe-2a5f-4399-b359-f19673e7b66e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:26.313955 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e273e7fe-2a5f-4399-b359-f19673e7b66e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:26.314372 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e273e7fe-2a5f-4399-b359-f19673e7b66e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:26.437385 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e273e7fe-2a5f-4399-b359-f19673e7b66e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:26.444822 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e273e7fe-2a5f-4399-b359-f19673e7b66e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.143438 Jun 15 15:54:26.445381 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 265/518] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:26 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:26.574080 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ef30d39e-67dc-4adf-a56d-d96d6799e731 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:26.574679 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ef30d39e-67dc-4adf-a56d-d96d6799e731 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:26.580683 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ef30d39e-67dc-4adf-a56d-d96d6799e731 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:26.581123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ef30d39e-67dc-4adf-a56d-d96d6799e731 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:26.581871 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ef30d39e-67dc-4adf-a56d-d96d6799e731 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:26.582298 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ef30d39e-67dc-4adf-a56d-d96d6799e731 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:26.710412 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ef30d39e-67dc-4adf-a56d-d96d6799e731 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:26.718489 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ef30d39e-67dc-4adf-a56d-d96d6799e731 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1709 microversion: 2.1 time: 0.148022 Jun 15 15:54:26.719200 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 254/519] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:26 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:27.283627 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4b17d7e7-f2c6-4685-9578-01a59c0f6ec0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:27.284255 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4b17d7e7-f2c6-4685-9578-01a59c0f6ec0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:27.286176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:27.292306 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4b17d7e7-f2c6-4685-9578-01a59c0f6ec0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:27.292759 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4b17d7e7-f2c6-4685-9578-01a59c0f6ec0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:27.293554 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4b17d7e7-f2c6-4685-9578-01a59c0f6ec0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:27.293987 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4b17d7e7-f2c6-4685-9578-01a59c0f6ec0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:27.419967 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4b17d7e7-f2c6-4685-9578-01a59c0f6ec0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:27.427802 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4b17d7e7-f2c6-4685-9578-01a59c0f6ec0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:27.429296 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4b17d7e7-f2c6-4685-9578-01a59c0f6ec0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:27.430423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4b17d7e7-f2c6-4685-9578-01a59c0f6ec0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.150926 Jun 15 15:54:27.431073 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 266/520] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:27 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:54:27.461908 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-af00d62c-f2fa-4e70-9b81-444a6a9d9876 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:27.462457 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-af00d62c-f2fa-4e70-9b81-444a6a9d9876 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:27.469025 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-af00d62c-f2fa-4e70-9b81-444a6a9d9876 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:27.469476 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-af00d62c-f2fa-4e70-9b81-444a6a9d9876 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:27.470240 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-af00d62c-f2fa-4e70-9b81-444a6a9d9876 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:27.470671 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-af00d62c-f2fa-4e70-9b81-444a6a9d9876 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:27.474574 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:27.597755 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-af00d62c-f2fa-4e70-9b81-444a6a9d9876 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:27.605134 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-af00d62c-f2fa-4e70-9b81-444a6a9d9876 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.147717 Jun 15 15:54:27.605696 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 255/521] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:27 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:27.736273 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d0981d1d-4dad-4693-ab05-07560db44e25 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:27.736803 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d0981d1d-4dad-4693-ab05-07560db44e25 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:27.743315 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d0981d1d-4dad-4693-ab05-07560db44e25 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:27.743759 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d0981d1d-4dad-4693-ab05-07560db44e25 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:27.744537 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d0981d1d-4dad-4693-ab05-07560db44e25 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:27.745003 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d0981d1d-4dad-4693-ab05-07560db44e25 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:27.872507 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d0981d1d-4dad-4693-ab05-07560db44e25 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:27.880866 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d0981d1d-4dad-4693-ab05-07560db44e25 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1709 microversion: 2.1 time: 0.148501 Jun 15 15:54:27.881417 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 267/522] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:27 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:28.448520 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-94ab64b8-9962-4fc3-a9ff-8d5a7339b10d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:28.449127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-94ab64b8-9962-4fc3-a9ff-8d5a7339b10d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:28.451059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:28.456288 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94ab64b8-9962-4fc3-a9ff-8d5a7339b10d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:28.456742 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94ab64b8-9962-4fc3-a9ff-8d5a7339b10d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:28.458005 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94ab64b8-9962-4fc3-a9ff-8d5a7339b10d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:28.458434 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94ab64b8-9962-4fc3-a9ff-8d5a7339b10d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:28.586564 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-94ab64b8-9962-4fc3-a9ff-8d5a7339b10d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:28.594457 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-94ab64b8-9962-4fc3-a9ff-8d5a7339b10d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:28.595995 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-94ab64b8-9962-4fc3-a9ff-8d5a7339b10d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:28.597141 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-94ab64b8-9962-4fc3-a9ff-8d5a7339b10d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.152602 Jun 15 15:54:28.597691 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 256/523] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:28 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:28.621210 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b172956e-fd3d-4239-bff0-f159bc6ce158 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:28.621845 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b172956e-fd3d-4239-bff0-f159bc6ce158 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:28.628339 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b172956e-fd3d-4239-bff0-f159bc6ce158 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:28.628803 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b172956e-fd3d-4239-bff0-f159bc6ce158 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:28.630052 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b172956e-fd3d-4239-bff0-f159bc6ce158 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:28.630478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b172956e-fd3d-4239-bff0-f159bc6ce158 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:28.756660 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b172956e-fd3d-4239-bff0-f159bc6ce158 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:28.763964 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b172956e-fd3d-4239-bff0-f159bc6ce158 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.146660 Jun 15 15:54:28.764518 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 268/524] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:28 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:28.897933 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-dc70284a-1dbb-4e68-a9a8-48a28eb85260 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:28.898542 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-dc70284a-1dbb-4e68-a9a8-48a28eb85260 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:28.904623 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dc70284a-1dbb-4e68-a9a8-48a28eb85260 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:28.905071 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dc70284a-1dbb-4e68-a9a8-48a28eb85260 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:28.905830 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dc70284a-1dbb-4e68-a9a8-48a28eb85260 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:28.906271 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dc70284a-1dbb-4e68-a9a8-48a28eb85260 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:29.033294 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-dc70284a-1dbb-4e68-a9a8-48a28eb85260 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:29.041405 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-dc70284a-1dbb-4e68-a9a8-48a28eb85260 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1709 microversion: 2.1 time: 0.147933 Jun 15 15:54:29.041967 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 257/525] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:28 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1709 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:29.616580 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b1d92e87-a8f7-424b-9cca-5ee9107512c3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:29.617117 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b1d92e87-a8f7-424b-9cca-5ee9107512c3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:29.623132 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1d92e87-a8f7-424b-9cca-5ee9107512c3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:29.623680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1d92e87-a8f7-424b-9cca-5ee9107512c3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:29.624324 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1d92e87-a8f7-424b-9cca-5ee9107512c3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:29.624759 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1d92e87-a8f7-424b-9cca-5ee9107512c3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:29.752522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b1d92e87-a8f7-424b-9cca-5ee9107512c3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:29.760585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b1d92e87-a8f7-424b-9cca-5ee9107512c3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:29.762097 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b1d92e87-a8f7-424b-9cca-5ee9107512c3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:29.763250 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b1d92e87-a8f7-424b-9cca-5ee9107512c3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.150723 Jun 15 15:54:29.763800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 269/526] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:29 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:29.780553 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-430a0a16-cbf3-439c-8d07-e9a887e9898f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:29.781158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-430a0a16-cbf3-439c-8d07-e9a887e9898f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:29.787971 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-430a0a16-cbf3-439c-8d07-e9a887e9898f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:29.788411 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-430a0a16-cbf3-439c-8d07-e9a887e9898f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:29.789163 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-430a0a16-cbf3-439c-8d07-e9a887e9898f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:29.789638 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-430a0a16-cbf3-439c-8d07-e9a887e9898f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:29.918999 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-430a0a16-cbf3-439c-8d07-e9a887e9898f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:29.926977 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-430a0a16-cbf3-439c-8d07-e9a887e9898f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.149751 Jun 15 15:54:29.927546 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 258/527] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:29 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:30.058367 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-67afd0c7-cb0c-457f-b89c-47300f2340a6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:30.059005 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-67afd0c7-cb0c-457f-b89c-47300f2340a6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:30.064932 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-67afd0c7-cb0c-457f-b89c-47300f2340a6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:30.065374 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-67afd0c7-cb0c-457f-b89c-47300f2340a6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:30.066151 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-67afd0c7-cb0c-457f-b89c-47300f2340a6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:30.066579 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-67afd0c7-cb0c-457f-b89c-47300f2340a6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:30.194028 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-67afd0c7-cb0c-457f-b89c-47300f2340a6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:30.201835 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-67afd0c7-cb0c-457f-b89c-47300f2340a6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1709 microversion: 2.1 time: 0.147282 Jun 15 15:54:30.202393 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 270/528] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:30 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1709 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:30.610845 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-ec570c9b-ec7d-4646-baa1-3fd547a3dda8 req-364cd21e-0c24-4137-92f7-7ee291736d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3418e7-7db0-4525-93e2-9646dde34b8b", "name": "network-vif-plugged", "status": "completed", "tag": "61559de7-75c9-4a3b-a009-2e5b844c72b0"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:30.619824 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-ec570c9b-ec7d-4646-baa1-3fd547a3dda8 req-364cd21e-0c24-4137-92f7-7ee291736d76 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:30.620268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-ec570c9b-ec7d-4646-baa1-3fd547a3dda8 req-364cd21e-0c24-4137-92f7-7ee291736d76 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:30.631164 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-ec570c9b-ec7d-4646-baa1-3fd547a3dda8 req-364cd21e-0c24-4137-92f7-7ee291736d76 service nova] Creating event network-vif-plugged:61559de7-75c9-4a3b-a009-2e5b844c72b0 for instance 4e3418e7-7db0-4525-93e2-9646dde34b8b on hv-cinder-84599 Jun 15 15:54:30.636095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-ec570c9b-ec7d-4646-baa1-3fd547a3dda8 req-364cd21e-0c24-4137-92f7-7ee291736d76 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029405 Jun 15 15:54:30.636674 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 259/529] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:54:30.780818 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5831dee6-477c-4175-acc4-e0f4169ffe64 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:30.781369 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5831dee6-477c-4175-acc4-e0f4169ffe64 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:30.788580 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5831dee6-477c-4175-acc4-e0f4169ffe64 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:30.789022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5831dee6-477c-4175-acc4-e0f4169ffe64 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:30.789773 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5831dee6-477c-4175-acc4-e0f4169ffe64 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:30.790201 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5831dee6-477c-4175-acc4-e0f4169ffe64 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:30.930621 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5831dee6-477c-4175-acc4-e0f4169ffe64 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:30.938466 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5831dee6-477c-4175-acc4-e0f4169ffe64 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:30.940478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5831dee6-477c-4175-acc4-e0f4169ffe64 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:30.941624 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5831dee6-477c-4175-acc4-e0f4169ffe64 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.164816 Jun 15 15:54:30.942681 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 271/530] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:30 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:30.945571 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-612e78d1-aca8-4be7-9118-d2136b5d62c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:30.946309 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-612e78d1-aca8-4be7-9118-d2136b5d62c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:30.952616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-612e78d1-aca8-4be7-9118-d2136b5d62c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:30.953059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-612e78d1-aca8-4be7-9118-d2136b5d62c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:30.953814 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-612e78d1-aca8-4be7-9118-d2136b5d62c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:30.954246 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-612e78d1-aca8-4be7-9118-d2136b5d62c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:31.080153 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-612e78d1-aca8-4be7-9118-d2136b5d62c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:31.088174 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-612e78d1-aca8-4be7-9118-d2136b5d62c2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.147710 Jun 15 15:54:31.088734 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 260/531] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:30 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:31.218786 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7e213b7c-7a5d-4cb0-b500-48427c50c2e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:31.219387 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7e213b7c-7a5d-4cb0-b500-48427c50c2e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:31.225334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7e213b7c-7a5d-4cb0-b500-48427c50c2e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:31.225772 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7e213b7c-7a5d-4cb0-b500-48427c50c2e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:31.226518 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7e213b7c-7a5d-4cb0-b500-48427c50c2e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:31.226976 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7e213b7c-7a5d-4cb0-b500-48427c50c2e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:31.353868 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7e213b7c-7a5d-4cb0-b500-48427c50c2e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:31.361726 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7e213b7c-7a5d-4cb0-b500-48427c50c2e2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1713 microversion: 2.1 time: 0.146793 Jun 15 15:54:31.362282 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 272/532] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:31 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1713 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:31.960495 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d9bca1b5-18a6-43f0-94cf-e3e56a549df1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:31.961095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d9bca1b5-18a6-43f0-94cf-e3e56a549df1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:31.968163 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d9bca1b5-18a6-43f0-94cf-e3e56a549df1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:31.968612 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d9bca1b5-18a6-43f0-94cf-e3e56a549df1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:31.969401 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d9bca1b5-18a6-43f0-94cf-e3e56a549df1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:31.969837 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d9bca1b5-18a6-43f0-94cf-e3e56a549df1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:32.094927 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d9bca1b5-18a6-43f0-94cf-e3e56a549df1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:32.103075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d9bca1b5-18a6-43f0-94cf-e3e56a549df1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:32.104100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cba8bec1-d5b0-47bd-ae9c-87b463da922d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:32.104587 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d9bca1b5-18a6-43f0-94cf-e3e56a549df1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:32.104732 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-cba8bec1-d5b0-47bd-ae9c-87b463da922d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:32.105734 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d9bca1b5-18a6-43f0-94cf-e3e56a549df1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.149281 Jun 15 15:54:32.106293 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 261/533] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:31 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:32.111266 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cba8bec1-d5b0-47bd-ae9c-87b463da922d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:32.111711 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cba8bec1-d5b0-47bd-ae9c-87b463da922d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:32.112467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cba8bec1-d5b0-47bd-ae9c-87b463da922d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:32.112894 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cba8bec1-d5b0-47bd-ae9c-87b463da922d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:32.237731 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cba8bec1-d5b0-47bd-ae9c-87b463da922d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:32.245517 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-cba8bec1-d5b0-47bd-ae9c-87b463da922d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.145172 Jun 15 15:54:32.246067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 273/534] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:32 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:33.124503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-74d46273-7874-48c8-8f0c-9a53bebd21f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:33.125107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-74d46273-7874-48c8-8f0c-9a53bebd21f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:33.131223 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-74d46273-7874-48c8-8f0c-9a53bebd21f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:33.131669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-74d46273-7874-48c8-8f0c-9a53bebd21f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:33.132455 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-74d46273-7874-48c8-8f0c-9a53bebd21f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:33.132891 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-74d46273-7874-48c8-8f0c-9a53bebd21f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:33.262385 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-74d46273-7874-48c8-8f0c-9a53bebd21f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:33.262810 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6bd2b379-fbf7-4fd6-a96c-20c80cc8fb5c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:33.263420 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6bd2b379-fbf7-4fd6-a96c-20c80cc8fb5c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:33.269812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6bd2b379-fbf7-4fd6-a96c-20c80cc8fb5c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:33.270247 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6bd2b379-fbf7-4fd6-a96c-20c80cc8fb5c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:33.270465 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-74d46273-7874-48c8-8f0c-9a53bebd21f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:33.271022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6bd2b379-fbf7-4fd6-a96c-20c80cc8fb5c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:33.271447 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6bd2b379-fbf7-4fd6-a96c-20c80cc8fb5c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:33.272018 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-74d46273-7874-48c8-8f0c-9a53bebd21f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:33.273167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-74d46273-7874-48c8-8f0c-9a53bebd21f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.152756 Jun 15 15:54:33.273723 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 262/535] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:33 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:33.396772 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6bd2b379-fbf7-4fd6-a96c-20c80cc8fb5c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:33.404045 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6bd2b379-fbf7-4fd6-a96c-20c80cc8fb5c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.145096 Jun 15 15:54:33.404600 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 274/536] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:33 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:34.292588 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e7463bae-64a7-42fc-a3fb-8bc00dd5f82c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:34.293224 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e7463bae-64a7-42fc-a3fb-8bc00dd5f82c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:34.299839 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e7463bae-64a7-42fc-a3fb-8bc00dd5f82c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:34.300286 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e7463bae-64a7-42fc-a3fb-8bc00dd5f82c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:34.301044 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e7463bae-64a7-42fc-a3fb-8bc00dd5f82c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:34.301470 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e7463bae-64a7-42fc-a3fb-8bc00dd5f82c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:34.420989 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7c7df99d-8fb1-4886-9bfe-d3397dfdbcb0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:34.421618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7c7df99d-8fb1-4886-9bfe-d3397dfdbcb0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:34.428474 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c7df99d-8fb1-4886-9bfe-d3397dfdbcb0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:34.428914 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c7df99d-8fb1-4886-9bfe-d3397dfdbcb0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:34.429677 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c7df99d-8fb1-4886-9bfe-d3397dfdbcb0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:34.430102 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c7df99d-8fb1-4886-9bfe-d3397dfdbcb0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:34.688680 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e7463bae-64a7-42fc-a3fb-8bc00dd5f82c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:34.697273 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e7463bae-64a7-42fc-a3fb-8bc00dd5f82c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:34.698810 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e7463bae-64a7-42fc-a3fb-8bc00dd5f82c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:34.699975 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e7463bae-64a7-42fc-a3fb-8bc00dd5f82c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.411672 Jun 15 15:54:34.700528 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 263/537] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:34 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:34.730507 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7c7df99d-8fb1-4886-9bfe-d3397dfdbcb0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:34.737773 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7c7df99d-8fb1-4886-9bfe-d3397dfdbcb0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.320935 Jun 15 15:54:34.738325 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 275/538] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:34 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:35.718582 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ad954d7f-7bfb-458a-97f7-8cd639cc9429 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:35.719225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ad954d7f-7bfb-458a-97f7-8cd639cc9429 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:35.725804 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ad954d7f-7bfb-458a-97f7-8cd639cc9429 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:35.726249 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ad954d7f-7bfb-458a-97f7-8cd639cc9429 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:35.727068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ad954d7f-7bfb-458a-97f7-8cd639cc9429 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:35.727505 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ad954d7f-7bfb-458a-97f7-8cd639cc9429 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:35.754874 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e0cd6c2a-f93b-4b11-9a0c-e3cb8533ef27 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:35.755482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e0cd6c2a-f93b-4b11-9a0c-e3cb8533ef27 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:35.761943 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e0cd6c2a-f93b-4b11-9a0c-e3cb8533ef27 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:35.762390 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e0cd6c2a-f93b-4b11-9a0c-e3cb8533ef27 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:35.763180 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e0cd6c2a-f93b-4b11-9a0c-e3cb8533ef27 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:35.763612 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e0cd6c2a-f93b-4b11-9a0c-e3cb8533ef27 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:35.904452 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ad954d7f-7bfb-458a-97f7-8cd639cc9429 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:35.912773 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ad954d7f-7bfb-458a-97f7-8cd639cc9429 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:35.914346 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ad954d7f-7bfb-458a-97f7-8cd639cc9429 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:35.915558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ad954d7f-7bfb-458a-97f7-8cd639cc9429 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.200826 Jun 15 15:54:35.916328 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 264/539] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:35 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:35.931456 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e0cd6c2a-f93b-4b11-9a0c-e3cb8533ef27 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:35.938807 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e0cd6c2a-f93b-4b11-9a0c-e3cb8533ef27 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.188303 Jun 15 15:54:35.939359 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 276/540] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:35 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:36.934278 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-803e4bc1-32dd-4ee7-b8af-a27a63c88878 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:36.934921 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-803e4bc1-32dd-4ee7-b8af-a27a63c88878 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:36.941448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-803e4bc1-32dd-4ee7-b8af-a27a63c88878 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:36.941881 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-803e4bc1-32dd-4ee7-b8af-a27a63c88878 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:36.942634 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-803e4bc1-32dd-4ee7-b8af-a27a63c88878 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:36.943181 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-803e4bc1-32dd-4ee7-b8af-a27a63c88878 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:36.959082 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d4197227-4bdb-4dc3-9a64-f9ee456bf08e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:36.959611 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d4197227-4bdb-4dc3-9a64-f9ee456bf08e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:36.966037 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4197227-4bdb-4dc3-9a64-f9ee456bf08e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:36.966532 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4197227-4bdb-4dc3-9a64-f9ee456bf08e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:36.967321 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4197227-4bdb-4dc3-9a64-f9ee456bf08e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:36.967749 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4197227-4bdb-4dc3-9a64-f9ee456bf08e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:37.146049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-803e4bc1-32dd-4ee7-b8af-a27a63c88878 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:37.150654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d4197227-4bdb-4dc3-9a64-f9ee456bf08e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:37.154341 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-803e4bc1-32dd-4ee7-b8af-a27a63c88878 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:37.155879 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-803e4bc1-32dd-4ee7-b8af-a27a63c88878 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:37.157050 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-803e4bc1-32dd-4ee7-b8af-a27a63c88878 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.226726 Jun 15 15:54:37.157597 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 265/541] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:36 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:37.158100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d4197227-4bdb-4dc3-9a64-f9ee456bf08e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.202998 Jun 15 15:54:37.158651 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 277/542] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:36 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:54:38.174646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7e94d7da-55a5-4536-ab5e-eaecd0dd1a2f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:38.175373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7e94d7da-55a5-4536-ab5e-eaecd0dd1a2f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:38.176350 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-11c6d167-095f-4f39-a74d-33b3bc48a5f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:38.176953 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-11c6d167-095f-4f39-a74d-33b3bc48a5f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:38.182459 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e94d7da-55a5-4536-ab5e-eaecd0dd1a2f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:38.182948 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e94d7da-55a5-4536-ab5e-eaecd0dd1a2f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:38.183539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-11c6d167-095f-4f39-a74d-33b3bc48a5f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:38.183830 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e94d7da-55a5-4536-ab5e-eaecd0dd1a2f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:38.183978 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-11c6d167-095f-4f39-a74d-33b3bc48a5f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:38.184267 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e94d7da-55a5-4536-ab5e-eaecd0dd1a2f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:38.184724 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-11c6d167-095f-4f39-a74d-33b3bc48a5f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:38.185147 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-11c6d167-095f-4f39-a74d-33b3bc48a5f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:38.380182 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7e94d7da-55a5-4536-ab5e-eaecd0dd1a2f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:38.383149 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-11c6d167-095f-4f39-a74d-33b3bc48a5f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:38.387661 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7e94d7da-55a5-4536-ab5e-eaecd0dd1a2f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.216809 Jun 15 15:54:38.388226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 266/543] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:38 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:38.391047 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-11c6d167-095f-4f39-a74d-33b3bc48a5f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:38.392542 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-11c6d167-095f-4f39-a74d-33b3bc48a5f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:38.393681 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-11c6d167-095f-4f39-a74d-33b3bc48a5f1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.221727 Jun 15 15:54:38.394226 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 278/544] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:38 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:54:39.404644 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b7796c27-4966-4ef6-a67b-1a74dbb33bc3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:39.405283 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b7796c27-4966-4ef6-a67b-1a74dbb33bc3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:39.412177 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-46c59505-668a-418d-a990-3a1ffc05e626 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:39.412609 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b7796c27-4966-4ef6-a67b-1a74dbb33bc3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:39.412775 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-46c59505-668a-418d-a990-3a1ffc05e626 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:39.413057 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b7796c27-4966-4ef6-a67b-1a74dbb33bc3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:39.413815 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b7796c27-4966-4ef6-a67b-1a74dbb33bc3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:39.414252 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b7796c27-4966-4ef6-a67b-1a74dbb33bc3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:39.419212 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-46c59505-668a-418d-a990-3a1ffc05e626 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:39.419651 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-46c59505-668a-418d-a990-3a1ffc05e626 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:39.420402 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-46c59505-668a-418d-a990-3a1ffc05e626 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:39.420826 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-46c59505-668a-418d-a990-3a1ffc05e626 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:39.605777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b7796c27-4966-4ef6-a67b-1a74dbb33bc3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:39.608916 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-46c59505-668a-418d-a990-3a1ffc05e626 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:39.613239 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b7796c27-4966-4ef6-a67b-1a74dbb33bc3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1367 microversion: 2.1 time: 0.212424 Jun 15 15:54:39.613887 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 267/545] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:39 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:39.617638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-46c59505-668a-418d-a990-3a1ffc05e626 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:39.619176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-46c59505-668a-418d-a990-3a1ffc05e626 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:39.620324 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-46c59505-668a-418d-a990-3a1ffc05e626 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1743 microversion: 2.20 time: 0.212750 Jun 15 15:54:39.621031 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 279/546] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:39 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1743 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:54:39.946657 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fc27dc01-28f3-43b8-a0a1-cb8d21d9044f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:39.947176 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fc27dc01-28f3-43b8-a0a1-cb8d21d9044f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:39.953100 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc27dc01-28f3-43b8-a0a1-cb8d21d9044f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:39.953542 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc27dc01-28f3-43b8-a0a1-cb8d21d9044f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:39.954297 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc27dc01-28f3-43b8-a0a1-cb8d21d9044f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:39.954740 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc27dc01-28f3-43b8-a0a1-cb8d21d9044f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:40.040531 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-fc27dc01-28f3-43b8-a0a1-cb8d21d9044f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lazy-loading 'services' on Instance uuid 3ca2bc05-4595-4e21-8291-04ab2e2d8969 {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:54:40.111179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fc27dc01-28f3-43b8-a0a1-cb8d21d9044f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969/os-volume_attachments/67613564-ff22-4134-a674-8fe60c226c86" status: 202 len: 0 microversion: 2.1 time: 0.168856 Jun 15 15:54:40.111761 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 268/547] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 15:54:39 2022] DELETE /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969/os-volume_attachments/67613564-ff22-4134-a674-8fe60c226c86 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:54:40.631605 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cb85ad80-8431-4e10-9786-7cf3a70694ff tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:40.632213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-cb85ad80-8431-4e10-9786-7cf3a70694ff tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:40.638948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cb85ad80-8431-4e10-9786-7cf3a70694ff tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:40.639365 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4946eb7f-fbf3-4cda-99b7-145318e36946 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:40.639812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cb85ad80-8431-4e10-9786-7cf3a70694ff tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:40.640059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4946eb7f-fbf3-4cda-99b7-145318e36946 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:40.640193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cb85ad80-8431-4e10-9786-7cf3a70694ff tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:40.640575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cb85ad80-8431-4e10-9786-7cf3a70694ff tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:40.648078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4946eb7f-fbf3-4cda-99b7-145318e36946 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:40.649026 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4946eb7f-fbf3-4cda-99b7-145318e36946 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:40.649515 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4946eb7f-fbf3-4cda-99b7-145318e36946 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:40.650056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4946eb7f-fbf3-4cda-99b7-145318e36946 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:40.657725 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:40.836247 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4946eb7f-fbf3-4cda-99b7-145318e36946 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:40.840203 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cb85ad80-8431-4e10-9786-7cf3a70694ff tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:40.844242 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4946eb7f-fbf3-4cda-99b7-145318e36946 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:40.845744 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4946eb7f-fbf3-4cda-99b7-145318e36946 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:40.846927 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4946eb7f-fbf3-4cda-99b7-145318e36946 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1743 microversion: 2.20 time: 0.212301 Jun 15 15:54:40.847475 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 269/548] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:40 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1743 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:40.847796 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-cb85ad80-8431-4e10-9786-7cf3a70694ff tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1556 microversion: 2.1 time: 0.220762 Jun 15 15:54:40.848484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 280/549] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:40 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1556 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:40.863523 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5f677df0-bb32-42fc-88be-47705b37ee3d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:40.864004 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5f677df0-bb32-42fc-88be-47705b37ee3d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:40.869825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5f677df0-bb32-42fc-88be-47705b37ee3d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:40.870341 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5f677df0-bb32-42fc-88be-47705b37ee3d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:40.871132 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5f677df0-bb32-42fc-88be-47705b37ee3d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:40.871564 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5f677df0-bb32-42fc-88be-47705b37ee3d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:40.951231 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5f677df0-bb32-42fc-88be-47705b37ee3d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091201 Jun 15 15:54:40.951826 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 270/550] 10.222.0.62 () {58 vars in 1274 bytes} [Wed Jun 15 15:54:40 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:54:41.856141 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-3c239c3a-1730-464b-9634-8a2b1580f40f req-c4a077ae-3074-493b-a81a-0625367abcfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3418e7-7db0-4525-93e2-9646dde34b8b", "tag": "61559de7-75c9-4a3b-a009-2e5b844c72b0"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:41.865301 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-3c239c3a-1730-464b-9634-8a2b1580f40f req-c4a077ae-3074-493b-a81a-0625367abcfb service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:41.865491 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c8e8ed00-c021-4c7b-ab44-0e2dd76e74d7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:41.865945 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-3c239c3a-1730-464b-9634-8a2b1580f40f req-c4a077ae-3074-493b-a81a-0625367abcfb service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:41.866119 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c8e8ed00-c021-4c7b-ab44-0e2dd76e74d7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:41.872209 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c8e8ed00-c021-4c7b-ab44-0e2dd76e74d7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:41.872650 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c8e8ed00-c021-4c7b-ab44-0e2dd76e74d7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:41.873397 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c8e8ed00-c021-4c7b-ab44-0e2dd76e74d7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:41.873821 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c8e8ed00-c021-4c7b-ab44-0e2dd76e74d7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:41.877379 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-3c239c3a-1730-464b-9634-8a2b1580f40f req-c4a077ae-3074-493b-a81a-0625367abcfb service nova] Creating event network-changed:61559de7-75c9-4a3b-a009-2e5b844c72b0 for instance 4e3418e7-7db0-4525-93e2-9646dde34b8b on hv-cinder-84599 Jun 15 15:54:41.882940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-3c239c3a-1730-464b-9634-8a2b1580f40f req-c4a077ae-3074-493b-a81a-0625367abcfb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030301 Jun 15 15:54:41.884022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 281/551] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:54:42.039755 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c8e8ed00-c021-4c7b-ab44-0e2dd76e74d7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:42.048566 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c8e8ed00-c021-4c7b-ab44-0e2dd76e74d7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:42.049673 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c8e8ed00-c021-4c7b-ab44-0e2dd76e74d7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:42.050860 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c8e8ed00-c021-4c7b-ab44-0e2dd76e74d7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1743 microversion: 2.20 time: 0.189882 Jun 15 15:54:42.061877 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 271/552] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:41 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1743 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:54:42.280024 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-249685f4-814d-46de-a197-a70b389b394f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:42.280810 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-249685f4-814d-46de-a197-a70b389b394f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:42.288238 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-249685f4-814d-46de-a197-a70b389b394f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:42.288700 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-249685f4-814d-46de-a197-a70b389b394f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:42.289566 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-249685f4-814d-46de-a197-a70b389b394f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:42.290209 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-249685f4-814d-46de-a197-a70b389b394f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:42.316428 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-249685f4-814d-46de-a197-a70b389b394f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Going to try to terminate instance {{(pid=123934) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:54:42.396150 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-249685f4-814d-46de-a197-a70b389b394f tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 204 len: 0 microversion: 2.1 time: 0.119880 Jun 15 15:54:42.397813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 282/553] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:54:42 2022] DELETE /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:54:42.405146 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1cbe445d-fa7a-4ae3-9173-98c2539c567a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:42.405762 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1cbe445d-fa7a-4ae3-9173-98c2539c567a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:42.417248 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1cbe445d-fa7a-4ae3-9173-98c2539c567a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:42.417698 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1cbe445d-fa7a-4ae3-9173-98c2539c567a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:42.418486 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1cbe445d-fa7a-4ae3-9173-98c2539c567a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:42.418994 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1cbe445d-fa7a-4ae3-9173-98c2539c567a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:42.424107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:42.600027 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1cbe445d-fa7a-4ae3-9173-98c2539c567a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:42.608023 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1cbe445d-fa7a-4ae3-9173-98c2539c567a tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1512 microversion: 2.1 time: 0.206518 Jun 15 15:54:42.608821 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 272/554] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:42 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:42.653555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-0bfb62cb-26bb-4f57-b0e6-dd0f5fe349f7 req-2ad7be7a-10a9-484a-9953-a27cb694c5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ff33fe-05bf-4bd5-9159-69805bae0aed", "name": "network-vif-plugged", "status": "completed", "tag": "229f5bd2-2de2-41f9-ac9f-ef6b3af254d6"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:42.662982 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-0bfb62cb-26bb-4f57-b0e6-dd0f5fe349f7 req-2ad7be7a-10a9-484a-9953-a27cb694c5f8 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:42.663494 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-0bfb62cb-26bb-4f57-b0e6-dd0f5fe349f7 req-2ad7be7a-10a9-484a-9953-a27cb694c5f8 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:42.678610 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-0bfb62cb-26bb-4f57-b0e6-dd0f5fe349f7 req-2ad7be7a-10a9-484a-9953-a27cb694c5f8 service nova] Creating event network-vif-plugged:229f5bd2-2de2-41f9-ac9f-ef6b3af254d6 for instance c8ff33fe-05bf-4bd5-9159-69805bae0aed on hv-cinder-84599 Jun 15 15:54:42.684129 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-0bfb62cb-26bb-4f57-b0e6-dd0f5fe349f7 req-2ad7be7a-10a9-484a-9953-a27cb694c5f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034643 Jun 15 15:54:42.684900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 283/555] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:54:43.070079 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-21c6e5d6-0b0c-42dc-8a14-caea58828da3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:43.070668 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-21c6e5d6-0b0c-42dc-8a14-caea58828da3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:43.077412 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21c6e5d6-0b0c-42dc-8a14-caea58828da3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:43.077806 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21c6e5d6-0b0c-42dc-8a14-caea58828da3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:43.079306 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21c6e5d6-0b0c-42dc-8a14-caea58828da3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:43.079306 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21c6e5d6-0b0c-42dc-8a14-caea58828da3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:43.208228 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-21c6e5d6-0b0c-42dc-8a14-caea58828da3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:43.216092 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-21c6e5d6-0b0c-42dc-8a14-caea58828da3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:43.217602 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-21c6e5d6-0b0c-42dc-8a14-caea58828da3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:43.218769 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-21c6e5d6-0b0c-42dc-8a14-caea58828da3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1743 microversion: 2.20 time: 0.153213 Jun 15 15:54:43.219334 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 273/556] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:43 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:43.626218 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8c81546a-bbcd-4599-bb6c-05f45333519c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:43.627057 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8c81546a-bbcd-4599-bb6c-05f45333519c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:43.633600 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8c81546a-bbcd-4599-bb6c-05f45333519c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:43.634050 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8c81546a-bbcd-4599-bb6c-05f45333519c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:43.634849 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8c81546a-bbcd-4599-bb6c-05f45333519c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:43.635281 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8c81546a-bbcd-4599-bb6c-05f45333519c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:43.764364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8c81546a-bbcd-4599-bb6c-05f45333519c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:43.771813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8c81546a-bbcd-4599-bb6c-05f45333519c tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1512 microversion: 2.1 time: 0.150335 Jun 15 15:54:43.772370 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 284/557] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:43 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:44.236820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b03b4505-ca97-4100-ac2b-7cfb3f1ced86 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:44.237427 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b03b4505-ca97-4100-ac2b-7cfb3f1ced86 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:44.243912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b03b4505-ca97-4100-ac2b-7cfb3f1ced86 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:44.244438 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b03b4505-ca97-4100-ac2b-7cfb3f1ced86 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:44.245200 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b03b4505-ca97-4100-ac2b-7cfb3f1ced86 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:44.245634 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b03b4505-ca97-4100-ac2b-7cfb3f1ced86 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:44.374869 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b03b4505-ca97-4100-ac2b-7cfb3f1ced86 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:44.383198 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b03b4505-ca97-4100-ac2b-7cfb3f1ced86 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:44.384704 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b03b4505-ca97-4100-ac2b-7cfb3f1ced86 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:44.385842 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b03b4505-ca97-4100-ac2b-7cfb3f1ced86 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1743 microversion: 2.20 time: 0.152972 Jun 15 15:54:44.386393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 274/558] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:44 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:44.788923 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1f68bf22-32e7-4395-a4a8-3e437bcef746 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:44.789529 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1f68bf22-32e7-4395-a4a8-3e437bcef746 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:44.796105 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1f68bf22-32e7-4395-a4a8-3e437bcef746 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:44.796562 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1f68bf22-32e7-4395-a4a8-3e437bcef746 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:44.797298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1f68bf22-32e7-4395-a4a8-3e437bcef746 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:44.797728 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1f68bf22-32e7-4395-a4a8-3e437bcef746 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:44.925812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1f68bf22-32e7-4395-a4a8-3e437bcef746 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:44.934044 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1f68bf22-32e7-4395-a4a8-3e437bcef746 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1512 microversion: 2.1 time: 0.149190 Jun 15 15:54:44.934693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 285/559] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:44 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:45.403617 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-84f2300b-3f4b-42e8-b1a3-1a81e330a545 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:45.404221 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-84f2300b-3f4b-42e8-b1a3-1a81e330a545 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:45.410624 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-84f2300b-3f4b-42e8-b1a3-1a81e330a545 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:45.411888 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-84f2300b-3f4b-42e8-b1a3-1a81e330a545 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:45.412653 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-84f2300b-3f4b-42e8-b1a3-1a81e330a545 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:45.413091 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-84f2300b-3f4b-42e8-b1a3-1a81e330a545 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:45.640873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-84f2300b-3f4b-42e8-b1a3-1a81e330a545 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:45.649367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-84f2300b-3f4b-42e8-b1a3-1a81e330a545 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:45.650910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-84f2300b-3f4b-42e8-b1a3-1a81e330a545 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:45.652202 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-84f2300b-3f4b-42e8-b1a3-1a81e330a545 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1743 microversion: 2.20 time: 0.252522 Jun 15 15:54:45.652756 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 275/560] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:45 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:45.828160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-66abcc23-90e7-4d34-855e-71c16d0a09fa req-4dbff69a-76ef-4f19-8b5c-e5f55ae1b05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca2bc05-4595-4e21-8291-04ab2e2d8969", "name": "network-vif-deleted", "tag": "9503184b-fdbc-4d44-acd4-a547060db68b"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:54:45.837487 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-66abcc23-90e7-4d34-855e-71c16d0a09fa req-4dbff69a-76ef-4f19-8b5c-e5f55ae1b05f service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:45.837916 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-66abcc23-90e7-4d34-855e-71c16d0a09fa req-4dbff69a-76ef-4f19-8b5c-e5f55ae1b05f service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:45.849103 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-66abcc23-90e7-4d34-855e-71c16d0a09fa req-4dbff69a-76ef-4f19-8b5c-e5f55ae1b05f service nova] Creating event network-vif-deleted:9503184b-fdbc-4d44-acd4-a547060db68b for instance 3ca2bc05-4595-4e21-8291-04ab2e2d8969 on hv-cinder-84599 Jun 15 15:54:45.853922 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-66abcc23-90e7-4d34-855e-71c16d0a09fa req-4dbff69a-76ef-4f19-8b5c-e5f55ae1b05f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029330 Jun 15 15:54:45.854522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 286/561] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:54:45.951893 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e6343d10-35ff-4d60-a642-32edb7f671d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:45.952490 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e6343d10-35ff-4d60-a642-32edb7f671d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:45.959336 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6343d10-35ff-4d60-a642-32edb7f671d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:45.959778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6343d10-35ff-4d60-a642-32edb7f671d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:45.960558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6343d10-35ff-4d60-a642-32edb7f671d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:45.960987 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6343d10-35ff-4d60-a642-32edb7f671d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:45.994218 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6343d10-35ff-4d60-a642-32edb7f671d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:45.994658 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6343d10-35ff-4d60-a642-32edb7f671d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:45.995137 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-e6343d10-35ff-4d60-a642-32edb7f671d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lazy-loading 'fault' on Instance uuid 3ca2bc05-4595-4e21-8291-04ab2e2d8969 {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:54:46.044656 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e6343d10-35ff-4d60-a642-32edb7f671d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e872bc2e7b214f0889ba95cc9352c59b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf53255e905344409fd64e4fba710dbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:46.052213 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e6343d10-35ff-4d60-a642-32edb7f671d3 tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 200 len: 1309 microversion: 2.1 time: 0.104218 Jun 15 15:54:46.052800 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 276/562] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:45 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:54:46.671146 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-435c2f1e-48ca-4d9c-9fbf-964cf14a78ea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:46.671823 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-435c2f1e-48ca-4d9c-9fbf-964cf14a78ea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:46.678493 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-435c2f1e-48ca-4d9c-9fbf-964cf14a78ea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:46.678984 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-435c2f1e-48ca-4d9c-9fbf-964cf14a78ea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:46.679806 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-435c2f1e-48ca-4d9c-9fbf-964cf14a78ea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:46.680285 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-435c2f1e-48ca-4d9c-9fbf-964cf14a78ea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:46.805688 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-435c2f1e-48ca-4d9c-9fbf-964cf14a78ea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:46.813448 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-435c2f1e-48ca-4d9c-9fbf-964cf14a78ea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:46.814991 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-435c2f1e-48ca-4d9c-9fbf-964cf14a78ea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:46.816124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-435c2f1e-48ca-4d9c-9fbf-964cf14a78ea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1743 microversion: 2.20 time: 0.149291 Jun 15 15:54:46.816988 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 287/563] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:46 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:47.069876 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-05b26342-1f3b-45b4-8736-a8202d322bbc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:47.070403 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-05b26342-1f3b-45b4-8736-a8202d322bbc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] [instance: 3ca2bc05-4595-4e21-8291-04ab2e2d8969] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:47.076861 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05b26342-1f3b-45b4-8736-a8202d322bbc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:47.077303 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05b26342-1f3b-45b4-8736-a8202d322bbc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:47.078087 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05b26342-1f3b-45b4-8736-a8202d322bbc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:47.078517 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05b26342-1f3b-45b4-8736-a8202d322bbc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:47.092648 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-05b26342-1f3b-45b4-8736-a8202d322bbc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] HTTP exception thrown: Instance 3ca2bc05-4595-4e21-8291-04ab2e2d8969 could not be found. Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-05b26342-1f3b-45b4-8736-a8202d322bbc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Request method failure captured: Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 HTTP/1.1 Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgAHiuO-TDwQKov1OBEBvoOIv-EGzRCYFgcKK40mAtrBAXnmBPZ0F3--akQqnFz3koOuwYFnaqnYfhq7qCJCd0DdJM1IvwxPEPb-GNoJ3CYDCwsdaifbvHOuOONf4fm9FNjxZcbQD6jpOMUIqGofPcTqdWghF_UfO9yLxqdqtQwCEps Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: bf53255e905344409fd64e4fba710dbc Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2112844530 Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:54:47.094299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/bf53255e905344409fd64e4fba710dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bf53255e905344409fd64e4fba710dbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/bf53255e905344409fd64e4fba710dbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_bf53255e905344409fd64e4fba710dbc", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-VolumesSnapshotTestJSON-2112844530 Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: bf53255e905344409fd64e4fba710dbc Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2112844530 Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-VolumesSnapshotTestJSON-2112844530-project Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: e872bc2e7b214f0889ba95cc9352c59b Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-VolumesSnapshotTestJSON-2112844530-project Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance 3ca2bc05-4595-4e21-8291-04ab2e2d8969 could not be found. Jun 15 15:54:47.095847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': '3ca2bc05-4595-4e21-8291-04ab2e2d8969'} Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ca2bc05-4595-4e21-8291-04ab2e2d8969 could not be found. Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:54:47.096733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ca2bc05-4595-4e21-8291-04ab2e2d8969 could not be found. Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ca2bc05-4595-4e21-8291-04ab2e2d8969 could not be found. Jun 15 15:54:47.099513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:54:47.100814 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-05b26342-1f3b-45b4-8736-a8202d322bbc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] Returning 404 to user: Instance 3ca2bc05-4595-4e21-8291-04ab2e2d8969 could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:54:47.100814 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-05b26342-1f3b-45b4-8736-a8202d322bbc tempest-VolumesSnapshotTestJSON-2112844530 tempest-VolumesSnapshotTestJSON-2112844530-project] 10.222.0.62 "GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969" status: 404 len: 111 microversion: 2.1 time: 0.029937 Jun 15 15:54:47.100814 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 277/564] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:54:47 2022] GET /compute/v2.1/servers/3ca2bc05-4595-4e21-8291-04ab2e2d8969 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:54:47.833472 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-db2eba01-8674-43bb-9283-320490eba4a3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:47.834120 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-db2eba01-8674-43bb-9283-320490eba4a3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:47.840587 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-db2eba01-8674-43bb-9283-320490eba4a3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:47.841020 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-db2eba01-8674-43bb-9283-320490eba4a3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:47.841764 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-db2eba01-8674-43bb-9283-320490eba4a3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:47.842186 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-db2eba01-8674-43bb-9283-320490eba4a3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:47.985254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-db2eba01-8674-43bb-9283-320490eba4a3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:47.993834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-db2eba01-8674-43bb-9283-320490eba4a3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:47.995375 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-db2eba01-8674-43bb-9283-320490eba4a3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:47.996505 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-db2eba01-8674-43bb-9283-320490eba4a3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1743 microversion: 2.20 time: 0.166964 Jun 15 15:54:47.997050 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 288/565] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:47 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:49.015347 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-37ea96b3-3e88-45d0-a7b9-83425255ab3c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:49.015962 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-37ea96b3-3e88-45d0-a7b9-83425255ab3c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:49.023450 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37ea96b3-3e88-45d0-a7b9-83425255ab3c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:49.023900 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37ea96b3-3e88-45d0-a7b9-83425255ab3c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:49.024726 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37ea96b3-3e88-45d0-a7b9-83425255ab3c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:49.025078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-37ea96b3-3e88-45d0-a7b9-83425255ab3c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:49.155516 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-37ea96b3-3e88-45d0-a7b9-83425255ab3c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:49.163815 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-37ea96b3-3e88-45d0-a7b9-83425255ab3c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:49.165393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-37ea96b3-3e88-45d0-a7b9-83425255ab3c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:49.166553 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-37ea96b3-3e88-45d0-a7b9-83425255ab3c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.155244 Jun 15 15:54:49.176849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 278/566] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:49 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:50.190121 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b753f500-3d3e-4efe-baa3-275daf27bf38 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:50.190831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b753f500-3d3e-4efe-baa3-275daf27bf38 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:50.198074 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b753f500-3d3e-4efe-baa3-275daf27bf38 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:50.198638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b753f500-3d3e-4efe-baa3-275daf27bf38 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:50.199666 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b753f500-3d3e-4efe-baa3-275daf27bf38 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:50.200187 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b753f500-3d3e-4efe-baa3-275daf27bf38 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:50.342888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b753f500-3d3e-4efe-baa3-275daf27bf38 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:50.352291 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b753f500-3d3e-4efe-baa3-275daf27bf38 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:50.354193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b753f500-3d3e-4efe-baa3-275daf27bf38 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:50.355505 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b753f500-3d3e-4efe-baa3-275daf27bf38 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.169745 Jun 15 15:54:50.356118 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 289/567] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:50 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:51.376805 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f47a1c9a-58f7-4bbb-9000-8453141f91f9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:51.378232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f47a1c9a-58f7-4bbb-9000-8453141f91f9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:51.384859 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f47a1c9a-58f7-4bbb-9000-8453141f91f9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:51.385441 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f47a1c9a-58f7-4bbb-9000-8453141f91f9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:51.386293 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f47a1c9a-58f7-4bbb-9000-8453141f91f9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:51.386833 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f47a1c9a-58f7-4bbb-9000-8453141f91f9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:51.555134 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f47a1c9a-58f7-4bbb-9000-8453141f91f9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:51.563715 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f47a1c9a-58f7-4bbb-9000-8453141f91f9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:51.565273 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f47a1c9a-58f7-4bbb-9000-8453141f91f9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:51.566428 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f47a1c9a-58f7-4bbb-9000-8453141f91f9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.195832 Jun 15 15:54:51.567239 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 279/568] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:51 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:52.584718 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-00b7af5f-214b-43f5-b0b9-c692746a600b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:52.585334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-00b7af5f-214b-43f5-b0b9-c692746a600b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:52.592847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00b7af5f-214b-43f5-b0b9-c692746a600b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:52.593381 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00b7af5f-214b-43f5-b0b9-c692746a600b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:52.594213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00b7af5f-214b-43f5-b0b9-c692746a600b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:52.594642 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00b7af5f-214b-43f5-b0b9-c692746a600b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:52.735637 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-00b7af5f-214b-43f5-b0b9-c692746a600b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:52.744512 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-00b7af5f-214b-43f5-b0b9-c692746a600b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:52.747223 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-00b7af5f-214b-43f5-b0b9-c692746a600b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:52.748399 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-00b7af5f-214b-43f5-b0b9-c692746a600b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.167706 Jun 15 15:54:52.750767 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 290/569] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:52 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:54:53.767358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fd44a6d5-bdaa-4f3e-a143-cbefee7624c2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:53.768635 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fd44a6d5-bdaa-4f3e-a143-cbefee7624c2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:53.776524 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fd44a6d5-bdaa-4f3e-a143-cbefee7624c2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:53.776980 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fd44a6d5-bdaa-4f3e-a143-cbefee7624c2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:53.777780 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fd44a6d5-bdaa-4f3e-a143-cbefee7624c2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:53.778219 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fd44a6d5-bdaa-4f3e-a143-cbefee7624c2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:54.165079 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fd44a6d5-bdaa-4f3e-a143-cbefee7624c2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:54.178448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fd44a6d5-bdaa-4f3e-a143-cbefee7624c2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:54.179994 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fd44a6d5-bdaa-4f3e-a143-cbefee7624c2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:54.181916 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fd44a6d5-bdaa-4f3e-a143-cbefee7624c2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.418094 Jun 15 15:54:54.183087 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 280/570] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:53 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:55.201255 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2aa54eb2-2ebf-4359-b621-bdd3a4460381 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:55.201863 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2aa54eb2-2ebf-4359-b621-bdd3a4460381 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:55.218401 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2aa54eb2-2ebf-4359-b621-bdd3a4460381 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:55.218882 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2aa54eb2-2ebf-4359-b621-bdd3a4460381 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:55.219661 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2aa54eb2-2ebf-4359-b621-bdd3a4460381 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:55.220088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2aa54eb2-2ebf-4359-b621-bdd3a4460381 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:55.427556 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2aa54eb2-2ebf-4359-b621-bdd3a4460381 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:55.445591 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2aa54eb2-2ebf-4359-b621-bdd3a4460381 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:55.448066 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2aa54eb2-2ebf-4359-b621-bdd3a4460381 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:55.449471 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2aa54eb2-2ebf-4359-b621-bdd3a4460381 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.252079 Jun 15 15:54:55.460745 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 291/571] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:55 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:56.468863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3680ce9a-be06-404a-8276-774128901275 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:56.469557 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3680ce9a-be06-404a-8276-774128901275 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:56.477713 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3680ce9a-be06-404a-8276-774128901275 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:56.478138 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3680ce9a-be06-404a-8276-774128901275 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:56.479213 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3680ce9a-be06-404a-8276-774128901275 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:56.479848 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3680ce9a-be06-404a-8276-774128901275 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:56.622474 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3680ce9a-be06-404a-8276-774128901275 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:56.631190 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3680ce9a-be06-404a-8276-774128901275 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:56.632995 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3680ce9a-be06-404a-8276-774128901275 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:56.634359 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3680ce9a-be06-404a-8276-774128901275 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.169775 Jun 15 15:54:56.634942 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 281/572] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:56 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:57.653583 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-65ce47ec-5822-4c1c-8426-c50bc5b7e182 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:57.655011 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-65ce47ec-5822-4c1c-8426-c50bc5b7e182 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:57.665390 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:57.667490 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-65ce47ec-5822-4c1c-8426-c50bc5b7e182 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:57.668110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-65ce47ec-5822-4c1c-8426-c50bc5b7e182 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:57.669506 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-65ce47ec-5822-4c1c-8426-c50bc5b7e182 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:57.670237 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-65ce47ec-5822-4c1c-8426-c50bc5b7e182 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:57.862172 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-65ce47ec-5822-4c1c-8426-c50bc5b7e182 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:57.872258 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-65ce47ec-5822-4c1c-8426-c50bc5b7e182 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:57.874027 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-65ce47ec-5822-4c1c-8426-c50bc5b7e182 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:57.875234 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-65ce47ec-5822-4c1c-8426-c50bc5b7e182 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.226203 Jun 15 15:54:57.876085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 292/573] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:57 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:54:58.895375 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d4a47cbf-fa1e-4fc8-8224-66aca86960c1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:54:58.896649 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d4a47cbf-fa1e-4fc8-8224-66aca86960c1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:54:58.913213 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=54 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:54:58.915545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d4a47cbf-fa1e-4fc8-8224-66aca86960c1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:58.916993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d4a47cbf-fa1e-4fc8-8224-66aca86960c1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:58.916993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d4a47cbf-fa1e-4fc8-8224-66aca86960c1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:54:58.917389 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d4a47cbf-fa1e-4fc8-8224-66aca86960c1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:54:59.081912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d4a47cbf-fa1e-4fc8-8224-66aca86960c1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:59.102120 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d4a47cbf-fa1e-4fc8-8224-66aca86960c1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:59.103886 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d4a47cbf-fa1e-4fc8-8224-66aca86960c1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:54:59.104830 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d4a47cbf-fa1e-4fc8-8224-66aca86960c1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.214831 Jun 15 15:54:59.105379 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 282/574] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:54:58 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:00.123841 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b1abffa3-f1e9-4939-bb49-b9b3d57e9497 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:00.124444 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b1abffa3-f1e9-4939-bb49-b9b3d57e9497 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:00.130495 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1abffa3-f1e9-4939-bb49-b9b3d57e9497 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:00.130983 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1abffa3-f1e9-4939-bb49-b9b3d57e9497 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:00.131741 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1abffa3-f1e9-4939-bb49-b9b3d57e9497 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:00.132176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b1abffa3-f1e9-4939-bb49-b9b3d57e9497 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:00.269000 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b1abffa3-f1e9-4939-bb49-b9b3d57e9497 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:00.276893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b1abffa3-f1e9-4939-bb49-b9b3d57e9497 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:00.278391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b1abffa3-f1e9-4939-bb49-b9b3d57e9497 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:00.279579 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b1abffa3-f1e9-4939-bb49-b9b3d57e9497 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.159786 Jun 15 15:55:00.280135 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 293/575] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:00 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:01.297598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-64c02f4f-56d9-40ba-b4f2-e40d5ecede2c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:01.298195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-64c02f4f-56d9-40ba-b4f2-e40d5ecede2c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:01.304717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-64c02f4f-56d9-40ba-b4f2-e40d5ecede2c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:01.305155 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-64c02f4f-56d9-40ba-b4f2-e40d5ecede2c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:01.305905 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-64c02f4f-56d9-40ba-b4f2-e40d5ecede2c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:01.306330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-64c02f4f-56d9-40ba-b4f2-e40d5ecede2c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:01.432368 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-64c02f4f-56d9-40ba-b4f2-e40d5ecede2c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:01.440222 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-64c02f4f-56d9-40ba-b4f2-e40d5ecede2c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:01.441707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-64c02f4f-56d9-40ba-b4f2-e40d5ecede2c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:01.442888 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-64c02f4f-56d9-40ba-b4f2-e40d5ecede2c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.149158 Jun 15 15:55:01.443437 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 283/576] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:01 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:02.460872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1270c957-4836-41e1-9896-820ebeedc3f3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:02.461476 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1270c957-4836-41e1-9896-820ebeedc3f3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:02.467969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1270c957-4836-41e1-9896-820ebeedc3f3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:02.468412 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1270c957-4836-41e1-9896-820ebeedc3f3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:02.469162 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1270c957-4836-41e1-9896-820ebeedc3f3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:02.469593 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1270c957-4836-41e1-9896-820ebeedc3f3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:02.597388 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1270c957-4836-41e1-9896-820ebeedc3f3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:02.605720 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1270c957-4836-41e1-9896-820ebeedc3f3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:02.607249 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1270c957-4836-41e1-9896-820ebeedc3f3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:02.608385 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1270c957-4836-41e1-9896-820ebeedc3f3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.151413 Jun 15 15:55:02.608938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 294/577] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:02 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:03.732812 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-61931a62-aa23-406e-bbff-db113665ff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:03.733832 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-61931a62-aa23-406e-bbff-db113665ff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:03.740429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61931a62-aa23-406e-bbff-db113665ff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:03.740892 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61931a62-aa23-406e-bbff-db113665ff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:03.741643 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61931a62-aa23-406e-bbff-db113665ff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:03.742072 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61931a62-aa23-406e-bbff-db113665ff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:03.868295 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-61931a62-aa23-406e-bbff-db113665ff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:03.876143 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-61931a62-aa23-406e-bbff-db113665ff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:03.877638 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-61931a62-aa23-406e-bbff-db113665ff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:03.878799 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-61931a62-aa23-406e-bbff-db113665ff88 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.256106 Jun 15 15:55:03.879353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 284/578] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:03 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:04.897495 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-100611a2-1cd2-40d0-abfe-e2731cc56161 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:04.898096 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-100611a2-1cd2-40d0-abfe-e2731cc56161 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:04.904758 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-100611a2-1cd2-40d0-abfe-e2731cc56161 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:04.905204 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-100611a2-1cd2-40d0-abfe-e2731cc56161 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:04.905954 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-100611a2-1cd2-40d0-abfe-e2731cc56161 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:04.906384 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-100611a2-1cd2-40d0-abfe-e2731cc56161 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:05.035064 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-100611a2-1cd2-40d0-abfe-e2731cc56161 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:05.043951 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-100611a2-1cd2-40d0-abfe-e2731cc56161 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:05.045419 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-100611a2-1cd2-40d0-abfe-e2731cc56161 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:05.046544 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-100611a2-1cd2-40d0-abfe-e2731cc56161 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1738 microversion: 2.20 time: 0.152970 Jun 15 15:55:05.047130 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 295/579] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:04 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:06.065427 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f9877dff-84ba-42d0-ba0e-156a08844936 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:06.066308 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f9877dff-84ba-42d0-ba0e-156a08844936 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:06.072823 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f9877dff-84ba-42d0-ba0e-156a08844936 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:06.073342 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f9877dff-84ba-42d0-ba0e-156a08844936 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:06.074182 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f9877dff-84ba-42d0-ba0e-156a08844936 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:06.074687 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f9877dff-84ba-42d0-ba0e-156a08844936 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:06.295081 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f9877dff-84ba-42d0-ba0e-156a08844936 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:06.304351 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f9877dff-84ba-42d0-ba0e-156a08844936 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:06.306262 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f9877dff-84ba-42d0-ba0e-156a08844936 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:06.307777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f9877dff-84ba-42d0-ba0e-156a08844936 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1720 microversion: 2.20 time: 0.246957 Jun 15 15:55:06.308474 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 285/580] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:06 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1720 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:07.326273 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f2ba5c0c-b5f8-4f78-9c24-4d20c3c173d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:07.326904 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f2ba5c0c-b5f8-4f78-9c24-4d20c3c173d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:07.333425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2ba5c0c-b5f8-4f78-9c24-4d20c3c173d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:07.333856 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2ba5c0c-b5f8-4f78-9c24-4d20c3c173d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:07.334595 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2ba5c0c-b5f8-4f78-9c24-4d20c3c173d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:07.335055 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f2ba5c0c-b5f8-4f78-9c24-4d20c3c173d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:07.460644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f2ba5c0c-b5f8-4f78-9c24-4d20c3c173d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:07.468617 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f2ba5c0c-b5f8-4f78-9c24-4d20c3c173d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:07.470093 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f2ba5c0c-b5f8-4f78-9c24-4d20c3c173d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:07.471289 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f2ba5c0c-b5f8-4f78-9c24-4d20c3c173d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1720 microversion: 2.20 time: 0.148946 Jun 15 15:55:07.471838 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 296/581] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:07 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:08.488367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d7558708-8a6e-4502-8f1e-5c88bd2e1c95 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:08.488974 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d7558708-8a6e-4502-8f1e-5c88bd2e1c95 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:08.495705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d7558708-8a6e-4502-8f1e-5c88bd2e1c95 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:08.496150 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d7558708-8a6e-4502-8f1e-5c88bd2e1c95 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:08.496948 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d7558708-8a6e-4502-8f1e-5c88bd2e1c95 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:08.497380 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d7558708-8a6e-4502-8f1e-5c88bd2e1c95 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:08.640675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d7558708-8a6e-4502-8f1e-5c88bd2e1c95 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:08.649684 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d7558708-8a6e-4502-8f1e-5c88bd2e1c95 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:08.651214 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d7558708-8a6e-4502-8f1e-5c88bd2e1c95 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:08.652363 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d7558708-8a6e-4502-8f1e-5c88bd2e1c95 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1720 microversion: 2.20 time: 0.167958 Jun 15 15:55:08.652914 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 286/582] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:08 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:09.670585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b7345bdb-8937-40d5-aafc-36fb9dc7ebef tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:09.671241 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b7345bdb-8937-40d5-aafc-36fb9dc7ebef tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:09.677734 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b7345bdb-8937-40d5-aafc-36fb9dc7ebef tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:09.678184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b7345bdb-8937-40d5-aafc-36fb9dc7ebef tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:09.678975 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b7345bdb-8937-40d5-aafc-36fb9dc7ebef tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:09.679410 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b7345bdb-8937-40d5-aafc-36fb9dc7ebef tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:09.693585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:55:09.809785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b7345bdb-8937-40d5-aafc-36fb9dc7ebef tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:09.818277 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b7345bdb-8937-40d5-aafc-36fb9dc7ebef tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:09.819809 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b7345bdb-8937-40d5-aafc-36fb9dc7ebef tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:09.820983 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b7345bdb-8937-40d5-aafc-36fb9dc7ebef tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1663 microversion: 2.20 time: 0.154297 Jun 15 15:55:09.821535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 297/583] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:09 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:09.839243 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-20fa81df-0e11-47c6-8c60-a22f1456f4de tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e9c4bdd-279b-4796-958d-af5d9b32dc29"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:55:09.840369 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-20fa81df-0e11-47c6-8c60-a22f1456f4de tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:09.846937 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-20fa81df-0e11-47c6-8c60-a22f1456f4de tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:09.847383 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-20fa81df-0e11-47c6-8c60-a22f1456f4de tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:09.848135 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-20fa81df-0e11-47c6-8c60-a22f1456f4de tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:09.848574 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-20fa81df-0e11-47c6-8c60-a22f1456f4de tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:10.023441 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:55:10.125074 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-20fa81df-0e11-47c6-8c60-a22f1456f4de tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289745 Jun 15 15:55:10.125679 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 287/584] 10.222.0.62 () {62 vars in 1363 bytes} [Wed Jun 15 15:55:09 2022] POST /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:55:10.243856 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bfa6f56c-4b75-4028-b6d5-877349788bf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:55:10.244418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bfa6f56c-4b75-4028-b6d5-877349788bf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:10.250486 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bfa6f56c-4b75-4028-b6d5-877349788bf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:10.250976 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bfa6f56c-4b75-4028-b6d5-877349788bf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:10.251739 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bfa6f56c-4b75-4028-b6d5-877349788bf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:10.252173 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bfa6f56c-4b75-4028-b6d5-877349788bf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:10.384940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bfa6f56c-4b75-4028-b6d5-877349788bf7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "POST /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/action" status: 202 len: 0 microversion: 2.20 time: 0.144938 Jun 15 15:55:10.388992 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 298/585] 10.222.0.62 () {62 vars in 1318 bytes} [Wed Jun 15 15:55:10 2022] POST /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:55:10.393798 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-41ce237a-41c8-4d11-bd0a-d00bd61951ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:10.394394 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-41ce237a-41c8-4d11-bd0a-d00bd61951ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:10.401243 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-41ce237a-41c8-4d11-bd0a-d00bd61951ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:10.401799 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-41ce237a-41c8-4d11-bd0a-d00bd61951ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:10.402610 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-41ce237a-41c8-4d11-bd0a-d00bd61951ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:10.403133 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-41ce237a-41c8-4d11-bd0a-d00bd61951ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:10.543567 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-41ce237a-41c8-4d11-bd0a-d00bd61951ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:10.552456 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-41ce237a-41c8-4d11-bd0a-d00bd61951ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:10.553949 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-41ce237a-41c8-4d11-bd0a-d00bd61951ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:10.555131 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-41ce237a-41c8-4d11-bd0a-d00bd61951ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1749 microversion: 2.20 time: 0.165202 Jun 15 15:55:10.555667 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 288/586] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:10 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:55:10.733433 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-46038143-5674-4103-8969-d72586496e3d req-0b4e5d8e-3849-4785-8d33-24bfb17f64f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ff33fe-05bf-4bd5-9159-69805bae0aed", "name": "network-vif-unplugged", "status": "completed", "tag": "229f5bd2-2de2-41f9-ac9f-ef6b3af254d6"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:55:10.746324 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-46038143-5674-4103-8969-d72586496e3d req-0b4e5d8e-3849-4785-8d33-24bfb17f64f7 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:10.746787 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-46038143-5674-4103-8969-d72586496e3d req-0b4e5d8e-3849-4785-8d33-24bfb17f64f7 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:10.757422 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.compute.server_external_events [req-46038143-5674-4103-8969-d72586496e3d req-0b4e5d8e-3849-4785-8d33-24bfb17f64f7 service nova] Unable to find a host for instance c8ff33fe-05bf-4bd5-9159-69805bae0aed. Dropping event network-vif-unplugged {{(pid=123934) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 15 15:55:10.758480 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-46038143-5674-4103-8969-d72586496e3d req-0b4e5d8e-3849-4785-8d33-24bfb17f64f7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029484 Jun 15 15:55:10.759110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 299/587] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 15 15:55:11.573883 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f675167c-43c5-45bc-9dcb-8ff040402c5f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:11.574485 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f675167c-43c5-45bc-9dcb-8ff040402c5f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:11.581357 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f675167c-43c5-45bc-9dcb-8ff040402c5f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:11.581806 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f675167c-43c5-45bc-9dcb-8ff040402c5f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:11.583229 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f675167c-43c5-45bc-9dcb-8ff040402c5f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:11.583659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f675167c-43c5-45bc-9dcb-8ff040402c5f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:11.708922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f675167c-43c5-45bc-9dcb-8ff040402c5f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:11.717183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f675167c-43c5-45bc-9dcb-8ff040402c5f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:11.718670 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f675167c-43c5-45bc-9dcb-8ff040402c5f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:11.719834 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f675167c-43c5-45bc-9dcb-8ff040402c5f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1751 microversion: 2.20 time: 0.149864 Jun 15 15:55:11.720397 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 289/588] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:11 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:12.738133 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bc22196c-4943-4624-aa42-c0878d302c5a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:12.739274 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bc22196c-4943-4624-aa42-c0878d302c5a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:12.745873 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc22196c-4943-4624-aa42-c0878d302c5a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:12.746320 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc22196c-4943-4624-aa42-c0878d302c5a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:12.747135 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc22196c-4943-4624-aa42-c0878d302c5a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:12.747563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc22196c-4943-4624-aa42-c0878d302c5a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:12.884987 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc22196c-4943-4624-aa42-c0878d302c5a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:12.893797 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc22196c-4943-4624-aa42-c0878d302c5a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:12.895339 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc22196c-4943-4624-aa42-c0878d302c5a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:12.896506 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bc22196c-4943-4624-aa42-c0878d302c5a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.162403 Jun 15 15:55:12.897056 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 300/589] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:12 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:13.916097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e21cc7c1-2852-4a2d-a2d7-be1688583aee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:13.916909 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e21cc7c1-2852-4a2d-a2d7-be1688583aee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:13.923785 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e21cc7c1-2852-4a2d-a2d7-be1688583aee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:13.924616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e21cc7c1-2852-4a2d-a2d7-be1688583aee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:13.925565 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e21cc7c1-2852-4a2d-a2d7-be1688583aee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:13.927318 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e21cc7c1-2852-4a2d-a2d7-be1688583aee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:14.078489 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e21cc7c1-2852-4a2d-a2d7-be1688583aee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:14.087684 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e21cc7c1-2852-4a2d-a2d7-be1688583aee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:14.089582 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e21cc7c1-2852-4a2d-a2d7-be1688583aee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:14.091169 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e21cc7c1-2852-4a2d-a2d7-be1688583aee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.180207 Jun 15 15:55:14.091714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 290/590] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:13 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:15.109876 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-92d00139-fcc1-4ba1-8884-edeb3d78b828 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:15.111260 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-92d00139-fcc1-4ba1-8884-edeb3d78b828 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:15.118595 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-92d00139-fcc1-4ba1-8884-edeb3d78b828 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:15.119335 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-92d00139-fcc1-4ba1-8884-edeb3d78b828 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:15.120335 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-92d00139-fcc1-4ba1-8884-edeb3d78b828 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:15.120944 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-92d00139-fcc1-4ba1-8884-edeb3d78b828 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:15.659575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-92d00139-fcc1-4ba1-8884-edeb3d78b828 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:15.679386 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-92d00139-fcc1-4ba1-8884-edeb3d78b828 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:15.682076 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-92d00139-fcc1-4ba1-8884-edeb3d78b828 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:15.684179 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-92d00139-fcc1-4ba1-8884-edeb3d78b828 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.578417 Jun 15 15:55:15.685443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 301/591] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:15 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:16.707177 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-618eddb5-6e34-4265-9e8e-3eb2a03e42dd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:16.708387 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-618eddb5-6e34-4265-9e8e-3eb2a03e42dd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:16.714949 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-618eddb5-6e34-4265-9e8e-3eb2a03e42dd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:16.715597 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-618eddb5-6e34-4265-9e8e-3eb2a03e42dd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:16.716494 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-618eddb5-6e34-4265-9e8e-3eb2a03e42dd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:16.717129 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-618eddb5-6e34-4265-9e8e-3eb2a03e42dd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:16.853300 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-618eddb5-6e34-4265-9e8e-3eb2a03e42dd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:16.861590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-618eddb5-6e34-4265-9e8e-3eb2a03e42dd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:16.863127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-618eddb5-6e34-4265-9e8e-3eb2a03e42dd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:16.864362 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-618eddb5-6e34-4265-9e8e-3eb2a03e42dd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.162768 Jun 15 15:55:16.864921 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 291/592] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:16 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:17.883574 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f62b3ef3-c597-4b0d-929d-e9c6761204ff tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:17.884851 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f62b3ef3-c597-4b0d-929d-e9c6761204ff tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:17.891705 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f62b3ef3-c597-4b0d-929d-e9c6761204ff tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:17.892146 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f62b3ef3-c597-4b0d-929d-e9c6761204ff tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:17.892911 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f62b3ef3-c597-4b0d-929d-e9c6761204ff tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:17.893349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f62b3ef3-c597-4b0d-929d-e9c6761204ff tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:18.027194 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f62b3ef3-c597-4b0d-929d-e9c6761204ff tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:18.035881 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f62b3ef3-c597-4b0d-929d-e9c6761204ff tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:18.037966 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f62b3ef3-c597-4b0d-929d-e9c6761204ff tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:18.039164 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f62b3ef3-c597-4b0d-929d-e9c6761204ff tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.160717 Jun 15 15:55:18.039710 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 302/593] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:17 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:19.058423 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d29acf6e-ea6f-41c3-a4dc-3ec82e34acb1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:19.059958 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d29acf6e-ea6f-41c3-a4dc-3ec82e34acb1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:19.067301 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d29acf6e-ea6f-41c3-a4dc-3ec82e34acb1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:19.067743 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d29acf6e-ea6f-41c3-a4dc-3ec82e34acb1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:19.068530 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d29acf6e-ea6f-41c3-a4dc-3ec82e34acb1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:19.068955 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d29acf6e-ea6f-41c3-a4dc-3ec82e34acb1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:19.205982 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d29acf6e-ea6f-41c3-a4dc-3ec82e34acb1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:19.214485 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d29acf6e-ea6f-41c3-a4dc-3ec82e34acb1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:19.215998 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d29acf6e-ea6f-41c3-a4dc-3ec82e34acb1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:19.217142 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d29acf6e-ea6f-41c3-a4dc-3ec82e34acb1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.162883 Jun 15 15:55:19.217696 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 292/594] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:19 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:20.235314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d54717fb-97f1-4edb-8e0e-8751b7a0be4b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:20.235946 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d54717fb-97f1-4edb-8e0e-8751b7a0be4b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:20.242656 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d54717fb-97f1-4edb-8e0e-8751b7a0be4b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:20.243200 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d54717fb-97f1-4edb-8e0e-8751b7a0be4b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:20.244036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d54717fb-97f1-4edb-8e0e-8751b7a0be4b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:20.244535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d54717fb-97f1-4edb-8e0e-8751b7a0be4b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:20.398263 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d54717fb-97f1-4edb-8e0e-8751b7a0be4b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:20.409424 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d54717fb-97f1-4edb-8e0e-8751b7a0be4b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:20.411101 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d54717fb-97f1-4edb-8e0e-8751b7a0be4b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:20.413233 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d54717fb-97f1-4edb-8e0e-8751b7a0be4b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.182067 Jun 15 15:55:20.413823 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 303/595] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:20 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:21.432762 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-aa6829e4-3cf7-4fc6-981a-1247ebfdf1a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:21.433476 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-aa6829e4-3cf7-4fc6-981a-1247ebfdf1a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:21.440099 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aa6829e4-3cf7-4fc6-981a-1247ebfdf1a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:21.440553 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aa6829e4-3cf7-4fc6-981a-1247ebfdf1a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:21.441329 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aa6829e4-3cf7-4fc6-981a-1247ebfdf1a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:21.441766 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aa6829e4-3cf7-4fc6-981a-1247ebfdf1a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:21.578455 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-aa6829e4-3cf7-4fc6-981a-1247ebfdf1a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:21.587230 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-aa6829e4-3cf7-4fc6-981a-1247ebfdf1a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:21.588750 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-aa6829e4-3cf7-4fc6-981a-1247ebfdf1a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:21.589937 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-aa6829e4-3cf7-4fc6-981a-1247ebfdf1a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.161726 Jun 15 15:55:21.590691 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 293/596] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:21 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:22.607637 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-fae667b6-8268-46d5-81b8-49329dc767b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:22.608467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-fae667b6-8268-46d5-81b8-49329dc767b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:22.616207 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fae667b6-8268-46d5-81b8-49329dc767b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:22.616737 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fae667b6-8268-46d5-81b8-49329dc767b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:22.617579 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fae667b6-8268-46d5-81b8-49329dc767b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:22.618086 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fae667b6-8268-46d5-81b8-49329dc767b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:22.764085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fae667b6-8268-46d5-81b8-49329dc767b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:22.772958 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fae667b6-8268-46d5-81b8-49329dc767b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:22.774447 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fae667b6-8268-46d5-81b8-49329dc767b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:22.775632 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fae667b6-8268-46d5-81b8-49329dc767b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.171920 Jun 15 15:55:22.786144 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 304/597] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:22 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:23.793568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f5aa5bfb-ce7f-4417-85a5-9ff61c107be2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:23.794289 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f5aa5bfb-ce7f-4417-85a5-9ff61c107be2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:23.800969 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f5aa5bfb-ce7f-4417-85a5-9ff61c107be2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:23.801448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f5aa5bfb-ce7f-4417-85a5-9ff61c107be2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:23.802246 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f5aa5bfb-ce7f-4417-85a5-9ff61c107be2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:23.802682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f5aa5bfb-ce7f-4417-85a5-9ff61c107be2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:23.933345 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f5aa5bfb-ce7f-4417-85a5-9ff61c107be2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:23.941832 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f5aa5bfb-ce7f-4417-85a5-9ff61c107be2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:23.943799 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f5aa5bfb-ce7f-4417-85a5-9ff61c107be2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:23.944942 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f5aa5bfb-ce7f-4417-85a5-9ff61c107be2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.155457 Jun 15 15:55:23.945492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 294/598] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:23 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:24.964381 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bc976184-0ab3-4dc8-a066-fa754f82feca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:24.964992 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bc976184-0ab3-4dc8-a066-fa754f82feca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:24.971502 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc976184-0ab3-4dc8-a066-fa754f82feca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:24.971936 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc976184-0ab3-4dc8-a066-fa754f82feca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:24.972688 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc976184-0ab3-4dc8-a066-fa754f82feca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:24.973108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc976184-0ab3-4dc8-a066-fa754f82feca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:25.119364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc976184-0ab3-4dc8-a066-fa754f82feca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:25.127661 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc976184-0ab3-4dc8-a066-fa754f82feca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:25.129152 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc976184-0ab3-4dc8-a066-fa754f82feca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:25.130294 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bc976184-0ab3-4dc8-a066-fa754f82feca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.170029 Jun 15 15:55:25.130867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 305/599] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:24 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:26.148310 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8bc9db73-27aa-4f8a-9492-d93d12c3a672 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:26.149173 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-8bc9db73-27aa-4f8a-9492-d93d12c3a672 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:26.155383 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8bc9db73-27aa-4f8a-9492-d93d12c3a672 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:26.155825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8bc9db73-27aa-4f8a-9492-d93d12c3a672 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:26.156605 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8bc9db73-27aa-4f8a-9492-d93d12c3a672 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:26.157030 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8bc9db73-27aa-4f8a-9492-d93d12c3a672 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:26.281625 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8bc9db73-27aa-4f8a-9492-d93d12c3a672 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:26.290948 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8bc9db73-27aa-4f8a-9492-d93d12c3a672 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:26.292465 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8bc9db73-27aa-4f8a-9492-d93d12c3a672 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:26.293618 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-8bc9db73-27aa-4f8a-9492-d93d12c3a672 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.149215 Jun 15 15:55:26.294180 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 295/600] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:26 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:27.311435 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-abdaea08-b092-4fd5-8557-27666cf55346 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:27.312027 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-abdaea08-b092-4fd5-8557-27666cf55346 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:27.319119 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-abdaea08-b092-4fd5-8557-27666cf55346 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:27.319556 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-abdaea08-b092-4fd5-8557-27666cf55346 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:27.320296 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-abdaea08-b092-4fd5-8557-27666cf55346 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:27.320720 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-abdaea08-b092-4fd5-8557-27666cf55346 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:27.447321 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-abdaea08-b092-4fd5-8557-27666cf55346 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:27.455684 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-abdaea08-b092-4fd5-8557-27666cf55346 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:27.457186 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-abdaea08-b092-4fd5-8557-27666cf55346 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:27.458335 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-abdaea08-b092-4fd5-8557-27666cf55346 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.150798 Jun 15 15:55:27.458912 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 306/601] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:27 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:28.476442 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-aa5e8c77-80d7-4314-9ed6-aaedca1e0d09 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:28.477052 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-aa5e8c77-80d7-4314-9ed6-aaedca1e0d09 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:28.483674 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aa5e8c77-80d7-4314-9ed6-aaedca1e0d09 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:28.484125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aa5e8c77-80d7-4314-9ed6-aaedca1e0d09 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:28.484887 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aa5e8c77-80d7-4314-9ed6-aaedca1e0d09 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:28.485327 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aa5e8c77-80d7-4314-9ed6-aaedca1e0d09 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:28.614481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-aa5e8c77-80d7-4314-9ed6-aaedca1e0d09 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:28.622714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-aa5e8c77-80d7-4314-9ed6-aaedca1e0d09 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:28.624228 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-aa5e8c77-80d7-4314-9ed6-aaedca1e0d09 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:28.625377 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-aa5e8c77-80d7-4314-9ed6-aaedca1e0d09 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.153342 Jun 15 15:55:28.625928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 296/602] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:28 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:29.643519 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-89e3f220-0a9b-46d8-9d3c-cc7b24884f36 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:29.644124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-89e3f220-0a9b-46d8-9d3c-cc7b24884f36 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:29.646506 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=32 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:55:29.651821 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89e3f220-0a9b-46d8-9d3c-cc7b24884f36 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:29.652264 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89e3f220-0a9b-46d8-9d3c-cc7b24884f36 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:29.653016 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89e3f220-0a9b-46d8-9d3c-cc7b24884f36 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:29.653443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89e3f220-0a9b-46d8-9d3c-cc7b24884f36 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:29.778151 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-89e3f220-0a9b-46d8-9d3c-cc7b24884f36 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:29.787104 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-89e3f220-0a9b-46d8-9d3c-cc7b24884f36 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:29.788618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-89e3f220-0a9b-46d8-9d3c-cc7b24884f36 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:29.789750 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-89e3f220-0a9b-46d8-9d3c-cc7b24884f36 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.150148 Jun 15 15:55:29.790310 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 307/603] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:29 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:30.808298 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7c5504cd-9fb6-4eb7-b1cb-8c890a18edf3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:30.808833 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7c5504cd-9fb6-4eb7-b1cb-8c890a18edf3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:30.811285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=30 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:55:30.816601 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c5504cd-9fb6-4eb7-b1cb-8c890a18edf3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:30.817045 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c5504cd-9fb6-4eb7-b1cb-8c890a18edf3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:30.818460 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c5504cd-9fb6-4eb7-b1cb-8c890a18edf3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:30.818934 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c5504cd-9fb6-4eb7-b1cb-8c890a18edf3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:30.946852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7c5504cd-9fb6-4eb7-b1cb-8c890a18edf3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:30.955218 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7c5504cd-9fb6-4eb7-b1cb-8c890a18edf3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:30.956728 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7c5504cd-9fb6-4eb7-b1cb-8c890a18edf3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:30.958367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7c5504cd-9fb6-4eb7-b1cb-8c890a18edf3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.153592 Jun 15 15:55:30.958968 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 297/604] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:30 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:55:31.976815 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f8c3aa49-69b0-4617-9cbe-2820527a0e30 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:31.977422 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f8c3aa49-69b0-4617-9cbe-2820527a0e30 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:31.984045 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f8c3aa49-69b0-4617-9cbe-2820527a0e30 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:31.984498 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f8c3aa49-69b0-4617-9cbe-2820527a0e30 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:31.985255 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f8c3aa49-69b0-4617-9cbe-2820527a0e30 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:31.985686 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f8c3aa49-69b0-4617-9cbe-2820527a0e30 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:32.110618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f8c3aa49-69b0-4617-9cbe-2820527a0e30 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:32.118877 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f8c3aa49-69b0-4617-9cbe-2820527a0e30 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:32.120354 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f8c3aa49-69b0-4617-9cbe-2820527a0e30 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:32.121479 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f8c3aa49-69b0-4617-9cbe-2820527a0e30 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.149108 Jun 15 15:55:32.122022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 308/605] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:31 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:33.139958 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-38c563c8-d3f3-499f-9d9a-2fc47f220551 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:33.140554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-38c563c8-d3f3-499f-9d9a-2fc47f220551 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:33.146754 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-38c563c8-d3f3-499f-9d9a-2fc47f220551 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:33.147220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-38c563c8-d3f3-499f-9d9a-2fc47f220551 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:33.147975 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-38c563c8-d3f3-499f-9d9a-2fc47f220551 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:33.148406 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-38c563c8-d3f3-499f-9d9a-2fc47f220551 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:33.274516 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-38c563c8-d3f3-499f-9d9a-2fc47f220551 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:33.282835 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-38c563c8-d3f3-499f-9d9a-2fc47f220551 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:33.284342 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-38c563c8-d3f3-499f-9d9a-2fc47f220551 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:33.285492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-38c563c8-d3f3-499f-9d9a-2fc47f220551 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.149491 Jun 15 15:55:33.286061 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 298/606] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:33 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:34.305206 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-28854d26-a303-4521-85f8-0745d198d615 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:34.305747 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-28854d26-a303-4521-85f8-0745d198d615 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:34.312307 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-28854d26-a303-4521-85f8-0745d198d615 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:34.312741 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-28854d26-a303-4521-85f8-0745d198d615 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:34.313486 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-28854d26-a303-4521-85f8-0745d198d615 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:34.313904 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-28854d26-a303-4521-85f8-0745d198d615 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:34.441650 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-28854d26-a303-4521-85f8-0745d198d615 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:34.450420 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-28854d26-a303-4521-85f8-0745d198d615 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:34.451938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-28854d26-a303-4521-85f8-0745d198d615 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:34.453078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-28854d26-a303-4521-85f8-0745d198d615 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.153262 Jun 15 15:55:34.453629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 309/607] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:34 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:35.471006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f7bd4913-57fd-4fc7-a830-5b37efb366be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:35.471648 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f7bd4913-57fd-4fc7-a830-5b37efb366be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:35.478168 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f7bd4913-57fd-4fc7-a830-5b37efb366be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:35.478618 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f7bd4913-57fd-4fc7-a830-5b37efb366be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:35.479453 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f7bd4913-57fd-4fc7-a830-5b37efb366be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:35.479889 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f7bd4913-57fd-4fc7-a830-5b37efb366be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:35.607769 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f7bd4913-57fd-4fc7-a830-5b37efb366be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:35.616631 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f7bd4913-57fd-4fc7-a830-5b37efb366be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:35.618138 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f7bd4913-57fd-4fc7-a830-5b37efb366be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:35.619313 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f7bd4913-57fd-4fc7-a830-5b37efb366be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.152245 Jun 15 15:55:35.619873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 299/608] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:35 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:36.637779 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0221cdd0-ebfa-49d0-9c81-18da23673d82 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:36.638413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0221cdd0-ebfa-49d0-9c81-18da23673d82 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:36.644910 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0221cdd0-ebfa-49d0-9c81-18da23673d82 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:36.645354 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0221cdd0-ebfa-49d0-9c81-18da23673d82 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:36.646108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0221cdd0-ebfa-49d0-9c81-18da23673d82 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:36.646539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0221cdd0-ebfa-49d0-9c81-18da23673d82 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:36.775598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0221cdd0-ebfa-49d0-9c81-18da23673d82 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:36.783781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0221cdd0-ebfa-49d0-9c81-18da23673d82 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:36.785258 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0221cdd0-ebfa-49d0-9c81-18da23673d82 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:36.787042 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0221cdd0-ebfa-49d0-9c81-18da23673d82 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.153125 Jun 15 15:55:36.787600 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 310/609] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:36 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:37.804759 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c5062070-adbf-4f51-9193-c7291a87f1df tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:37.805388 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c5062070-adbf-4f51-9193-c7291a87f1df tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:37.813845 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c5062070-adbf-4f51-9193-c7291a87f1df tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:37.814273 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c5062070-adbf-4f51-9193-c7291a87f1df tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:37.815055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c5062070-adbf-4f51-9193-c7291a87f1df tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:37.817945 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c5062070-adbf-4f51-9193-c7291a87f1df tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:37.945468 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c5062070-adbf-4f51-9193-c7291a87f1df tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:37.953770 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c5062070-adbf-4f51-9193-c7291a87f1df tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:37.955295 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c5062070-adbf-4f51-9193-c7291a87f1df tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:37.957372 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c5062070-adbf-4f51-9193-c7291a87f1df tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.156855 Jun 15 15:55:37.957939 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 300/610] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:37 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:38.975611 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-55020392-20f3-4766-b86a-d24c101b05f4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:38.976289 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-55020392-20f3-4766-b86a-d24c101b05f4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:38.985418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-55020392-20f3-4766-b86a-d24c101b05f4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:38.985860 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-55020392-20f3-4766-b86a-d24c101b05f4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:38.986804 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-55020392-20f3-4766-b86a-d24c101b05f4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:38.987248 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-55020392-20f3-4766-b86a-d24c101b05f4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:39.117167 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-55020392-20f3-4766-b86a-d24c101b05f4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:39.125498 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-55020392-20f3-4766-b86a-d24c101b05f4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:39.127032 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-55020392-20f3-4766-b86a-d24c101b05f4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:39.128174 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-55020392-20f3-4766-b86a-d24c101b05f4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.156620 Jun 15 15:55:39.128728 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 311/611] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:38 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:40.146786 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9a32dc5c-37d3-41c0-9379-a70ffad29d65 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:40.147396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9a32dc5c-37d3-41c0-9379-a70ffad29d65 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:40.153841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9a32dc5c-37d3-41c0-9379-a70ffad29d65 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:40.154287 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9a32dc5c-37d3-41c0-9379-a70ffad29d65 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:40.155078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9a32dc5c-37d3-41c0-9379-a70ffad29d65 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:40.155518 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9a32dc5c-37d3-41c0-9379-a70ffad29d65 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:40.159433 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:55:40.282220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9a32dc5c-37d3-41c0-9379-a70ffad29d65 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:40.291410 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9a32dc5c-37d3-41c0-9379-a70ffad29d65 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:40.292922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9a32dc5c-37d3-41c0-9379-a70ffad29d65 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:40.294078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9a32dc5c-37d3-41c0-9379-a70ffad29d65 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.151271 Jun 15 15:55:40.294639 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 301/612] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:40 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:41.100149 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-01d3581f-7b2c-4332-aad1-439b537dbe31 req-096b33c5-611b-457a-9386-357b908ae24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ff33fe-05bf-4bd5-9159-69805bae0aed", "name": "network-vif-plugged", "status": "completed", "tag": "229f5bd2-2de2-41f9-ac9f-ef6b3af254d6"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:55:41.108189 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-01d3581f-7b2c-4332-aad1-439b537dbe31 req-096b33c5-611b-457a-9386-357b908ae24a service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:41.108629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-01d3581f-7b2c-4332-aad1-439b537dbe31 req-096b33c5-611b-457a-9386-357b908ae24a service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:41.112229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:55:41.121813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-01d3581f-7b2c-4332-aad1-439b537dbe31 req-096b33c5-611b-457a-9386-357b908ae24a service nova] Creating event network-vif-plugged:229f5bd2-2de2-41f9-ac9f-ef6b3af254d6 for instance c8ff33fe-05bf-4bd5-9159-69805bae0aed on hv-cinder-84599 Jun 15 15:55:41.127033 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-01d3581f-7b2c-4332-aad1-439b537dbe31 req-096b33c5-611b-457a-9386-357b908ae24a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202807 Jun 15 15:55:41.127608 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 312/613] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:55:41.312788 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-542d63a3-6a1e-47d9-9f11-be74d1f776e7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:41.313393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-542d63a3-6a1e-47d9-9f11-be74d1f776e7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:41.320729 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-542d63a3-6a1e-47d9-9f11-be74d1f776e7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:41.321111 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-542d63a3-6a1e-47d9-9f11-be74d1f776e7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:41.321871 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-542d63a3-6a1e-47d9-9f11-be74d1f776e7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:41.322306 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-542d63a3-6a1e-47d9-9f11-be74d1f776e7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:41.451064 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-542d63a3-6a1e-47d9-9f11-be74d1f776e7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:41.459489 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-542d63a3-6a1e-47d9-9f11-be74d1f776e7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:41.460998 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-542d63a3-6a1e-47d9-9f11-be74d1f776e7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:41.462151 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-542d63a3-6a1e-47d9-9f11-be74d1f776e7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.153253 Jun 15 15:55:41.462699 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 302/614] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:41 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:42.481216 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9e4fdbe5-7dde-40b9-8f94-b3117c6a8f9b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:42.481891 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9e4fdbe5-7dde-40b9-8f94-b3117c6a8f9b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:42.489466 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9e4fdbe5-7dde-40b9-8f94-b3117c6a8f9b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:42.489900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9e4fdbe5-7dde-40b9-8f94-b3117c6a8f9b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:42.490676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9e4fdbe5-7dde-40b9-8f94-b3117c6a8f9b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:42.491131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9e4fdbe5-7dde-40b9-8f94-b3117c6a8f9b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:42.616884 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-9e4fdbe5-7dde-40b9-8f94-b3117c6a8f9b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:42.625120 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-9e4fdbe5-7dde-40b9-8f94-b3117c6a8f9b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:42.626659 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-9e4fdbe5-7dde-40b9-8f94-b3117c6a8f9b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:42.627830 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9e4fdbe5-7dde-40b9-8f94-b3117c6a8f9b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.151487 Jun 15 15:55:42.628411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 313/615] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:42 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:43.645861 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-88024bdb-aef0-4bac-aab6-3920000553c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:43.646466 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-88024bdb-aef0-4bac-aab6-3920000553c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:43.652917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88024bdb-aef0-4bac-aab6-3920000553c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:43.653360 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88024bdb-aef0-4bac-aab6-3920000553c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:43.654121 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88024bdb-aef0-4bac-aab6-3920000553c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:43.654556 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-88024bdb-aef0-4bac-aab6-3920000553c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:43.781288 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-88024bdb-aef0-4bac-aab6-3920000553c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:43.790529 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-88024bdb-aef0-4bac-aab6-3920000553c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:43.792074 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-88024bdb-aef0-4bac-aab6-3920000553c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:43.793225 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-88024bdb-aef0-4bac-aab6-3920000553c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.151830 Jun 15 15:55:43.793782 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 303/616] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:43 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:44.810241 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b2dd55f7-2163-45d7-b409-05a61eda3b28 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:44.810866 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b2dd55f7-2163-45d7-b409-05a61eda3b28 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:44.817740 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2dd55f7-2163-45d7-b409-05a61eda3b28 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:44.818179 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2dd55f7-2163-45d7-b409-05a61eda3b28 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:44.818978 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2dd55f7-2163-45d7-b409-05a61eda3b28 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:44.819408 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2dd55f7-2163-45d7-b409-05a61eda3b28 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:44.957205 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b2dd55f7-2163-45d7-b409-05a61eda3b28 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:44.966319 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b2dd55f7-2163-45d7-b409-05a61eda3b28 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:44.967772 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b2dd55f7-2163-45d7-b409-05a61eda3b28 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:44.969524 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b2dd55f7-2163-45d7-b409-05a61eda3b28 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1807 microversion: 2.20 time: 0.162675 Jun 15 15:55:44.969524 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 314/617] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:44 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:55:45.989241 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8c1707c8-be60-46b6-8980-73fb20afd8ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:55:45.989844 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-8c1707c8-be60-46b6-8980-73fb20afd8ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:55:45.996379 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8c1707c8-be60-46b6-8980-73fb20afd8ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:45.997000 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8c1707c8-be60-46b6-8980-73fb20afd8ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:45.997767 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8c1707c8-be60-46b6-8980-73fb20afd8ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:55:45.998204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8c1707c8-be60-46b6-8980-73fb20afd8ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:55:46.122951 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8c1707c8-be60-46b6-8980-73fb20afd8ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:46.131416 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8c1707c8-be60-46b6-8980-73fb20afd8ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:46.132916 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8c1707c8-be60-46b6-8980-73fb20afd8ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:55:46.134060 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-8c1707c8-be60-46b6-8980-73fb20afd8ee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1794 microversion: 2.20 time: 0.148797 Jun 15 15:55:46.134608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 304/618] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:55:45 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1794 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:56:02.768094 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=15 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:02.768765 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=13 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:02.870451 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1276fed7-e7c2-4159-bca1-55f5d9270e9f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:02.871064 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1276fed7-e7c2-4159-bca1-55f5d9270e9f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:02.877022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1276fed7-e7c2-4159-bca1-55f5d9270e9f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:02.877464 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1276fed7-e7c2-4159-bca1-55f5d9270e9f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:02.878215 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1276fed7-e7c2-4159-bca1-55f5d9270e9f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:02.878643 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1276fed7-e7c2-4159-bca1-55f5d9270e9f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:03.000557 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-1276fed7-e7c2-4159-bca1-55f5d9270e9f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lazy-loading 'services' on Instance uuid 9e67259e-9dd3-4875-9185-fa11291a54d9 {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:56:03.109558 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1276fed7-e7c2-4159-bca1-55f5d9270e9f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/os-volume_attachments/423edf20-d8ab-4b07-b3e6-fdfc6f3536ed" status: 202 len: 0 microversion: 2.1 time: 0.346166 Jun 15 15:56:03.110179 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 315/619] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 15:56:02 2022] DELETE /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/os-volume_attachments/423edf20-d8ab-4b07-b3e6-fdfc6f3536ed => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:56:04.221820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-69f10314-a53d-404e-86fd-e8bc290c254e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:04.224851 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=15 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:04.225790 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=23 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:04.232509 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-69f10314-a53d-404e-86fd-e8bc290c254e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:04.232958 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-69f10314-a53d-404e-86fd-e8bc290c254e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:04.256320 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-69f10314-a53d-404e-86fd-e8bc290c254e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Going to try to stop instance {{(pid=123935) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 15 15:56:04.297624 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-69f10314-a53d-404e-86fd-e8bc290c254e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "POST /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/action" status: 202 len: 0 microversion: 2.1 time: 0.079724 Jun 15 15:56:04.298223 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 305/620] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 15:56:04 2022] POST /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:56:04.308413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a74b937a-dd02-42bd-b1d9-43ca5005c7fe tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:04.309113 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a74b937a-dd02-42bd-b1d9-43ca5005c7fe tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:04.319372 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a74b937a-dd02-42bd-b1d9-43ca5005c7fe tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:04.319773 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a74b937a-dd02-42bd-b1d9-43ca5005c7fe tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:04.320544 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a74b937a-dd02-42bd-b1d9-43ca5005c7fe tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:04.320997 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a74b937a-dd02-42bd-b1d9-43ca5005c7fe tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:04.452229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a74b937a-dd02-42bd-b1d9-43ca5005c7fe tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:04.459872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a74b937a-dd02-42bd-b1d9-43ca5005c7fe tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.157244 Jun 15 15:56:04.460433 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 316/621] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:04 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:05.478606 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d123d66b-87dd-40d1-b1ac-4a51f43988fc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:05.479343 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d123d66b-87dd-40d1-b1ac-4a51f43988fc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:05.485783 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d123d66b-87dd-40d1-b1ac-4a51f43988fc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:05.486231 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d123d66b-87dd-40d1-b1ac-4a51f43988fc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:05.487068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d123d66b-87dd-40d1-b1ac-4a51f43988fc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:05.487493 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d123d66b-87dd-40d1-b1ac-4a51f43988fc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:05.615082 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d123d66b-87dd-40d1-b1ac-4a51f43988fc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:05.622717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d123d66b-87dd-40d1-b1ac-4a51f43988fc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.149163 Jun 15 15:56:05.623321 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 306/622] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:05 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:06.640225 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0d90e732-64b5-4dc2-b94f-a2b791a8f530 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:06.640837 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0d90e732-64b5-4dc2-b94f-a2b791a8f530 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:06.647333 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0d90e732-64b5-4dc2-b94f-a2b791a8f530 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:06.647782 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0d90e732-64b5-4dc2-b94f-a2b791a8f530 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:06.648541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0d90e732-64b5-4dc2-b94f-a2b791a8f530 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:06.648976 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0d90e732-64b5-4dc2-b94f-a2b791a8f530 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:06.778613 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0d90e732-64b5-4dc2-b94f-a2b791a8f530 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:06.786265 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0d90e732-64b5-4dc2-b94f-a2b791a8f530 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.149621 Jun 15 15:56:06.787456 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 317/623] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:06 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:07.804187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4950f9d3-decf-4b12-91de-6cdbc2a1c415 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:07.804943 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4950f9d3-decf-4b12-91de-6cdbc2a1c415 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:07.812239 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4950f9d3-decf-4b12-91de-6cdbc2a1c415 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:07.812683 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4950f9d3-decf-4b12-91de-6cdbc2a1c415 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:07.813469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4950f9d3-decf-4b12-91de-6cdbc2a1c415 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:07.813900 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4950f9d3-decf-4b12-91de-6cdbc2a1c415 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:07.945203 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4950f9d3-decf-4b12-91de-6cdbc2a1c415 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:07.952842 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4950f9d3-decf-4b12-91de-6cdbc2a1c415 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.152978 Jun 15 15:56:07.953409 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 307/624] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:07 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:08.970084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-01607313-fa44-4b75-b994-6551c050242f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:08.970799 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-01607313-fa44-4b75-b994-6551c050242f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:08.977132 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-01607313-fa44-4b75-b994-6551c050242f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:08.977575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-01607313-fa44-4b75-b994-6551c050242f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:08.978323 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-01607313-fa44-4b75-b994-6551c050242f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:08.978768 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-01607313-fa44-4b75-b994-6551c050242f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:09.108395 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-01607313-fa44-4b75-b994-6551c050242f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:09.116239 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-01607313-fa44-4b75-b994-6551c050242f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.150067 Jun 15 15:56:09.116798 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 318/625] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:08 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:09.741663 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5a23637f-3471-4dc4-b89d-4b2330c69eaa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c99c8b13-3325-46d5-bf69-d34e23fdf4b7"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:09.742798 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5a23637f-3471-4dc4-b89d-4b2330c69eaa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:09.749263 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5a23637f-3471-4dc4-b89d-4b2330c69eaa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:09.749711 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5a23637f-3471-4dc4-b89d-4b2330c69eaa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:09.750477 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5a23637f-3471-4dc4-b89d-4b2330c69eaa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:09.750944 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5a23637f-3471-4dc4-b89d-4b2330c69eaa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:10.007897 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5a23637f-3471-4dc4-b89d-4b2330c69eaa tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "POST /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270739 Jun 15 15:56:10.008429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 308/626] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 15:56:09 2022] POST /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:10.133219 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-84143e50-db80-4db8-865f-4f23cee3c6ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:10.133918 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-84143e50-db80-4db8-865f-4f23cee3c6ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:10.140332 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84143e50-db80-4db8-865f-4f23cee3c6ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:10.140778 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84143e50-db80-4db8-865f-4f23cee3c6ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:10.141524 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84143e50-db80-4db8-865f-4f23cee3c6ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:10.141953 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84143e50-db80-4db8-865f-4f23cee3c6ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:10.278001 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-84143e50-db80-4db8-865f-4f23cee3c6ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:10.285441 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-84143e50-db80-4db8-865f-4f23cee3c6ea tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.156568 Jun 15 15:56:10.286257 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 319/627] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:10 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:11.305030 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d6b153b5-9a82-4e20-b88f-ee38860bd6b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:11.305708 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d6b153b5-9a82-4e20-b88f-ee38860bd6b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:11.312199 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d6b153b5-9a82-4e20-b88f-ee38860bd6b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:11.312648 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d6b153b5-9a82-4e20-b88f-ee38860bd6b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:11.313407 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d6b153b5-9a82-4e20-b88f-ee38860bd6b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:11.313838 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d6b153b5-9a82-4e20-b88f-ee38860bd6b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:11.441131 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d6b153b5-9a82-4e20-b88f-ee38860bd6b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:11.448689 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d6b153b5-9a82-4e20-b88f-ee38860bd6b0 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.148487 Jun 15 15:56:11.449255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 309/628] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:11 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:12.465303 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0e687f0a-c4c7-4ea1-9ca3-678045a1b867 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:12.465906 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0e687f0a-c4c7-4ea1-9ca3-678045a1b867 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:12.472312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e687f0a-c4c7-4ea1-9ca3-678045a1b867 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:12.472757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e687f0a-c4c7-4ea1-9ca3-678045a1b867 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:12.473508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e687f0a-c4c7-4ea1-9ca3-678045a1b867 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:12.473935 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e687f0a-c4c7-4ea1-9ca3-678045a1b867 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:12.607865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0e687f0a-c4c7-4ea1-9ca3-678045a1b867 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:12.615299 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0e687f0a-c4c7-4ea1-9ca3-678045a1b867 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.153875 Jun 15 15:56:12.616458 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 320/629] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:12 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:13.633353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c49b82e4-6bca-4c3a-a306-0f9776ecf50a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:13.633952 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c49b82e4-6bca-4c3a-a306-0f9776ecf50a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:13.640623 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c49b82e4-6bca-4c3a-a306-0f9776ecf50a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:13.641064 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c49b82e4-6bca-4c3a-a306-0f9776ecf50a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:13.641818 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c49b82e4-6bca-4c3a-a306-0f9776ecf50a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:13.642239 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c49b82e4-6bca-4c3a-a306-0f9776ecf50a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:13.770400 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c49b82e4-6bca-4c3a-a306-0f9776ecf50a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:13.777903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c49b82e4-6bca-4c3a-a306-0f9776ecf50a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.149098 Jun 15 15:56:13.778467 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 310/630] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:13 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:14.795300 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6e459266-7d60-44bd-9028-d9a6e51bab67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:14.795937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6e459266-7d60-44bd-9028-d9a6e51bab67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:14.802522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6e459266-7d60-44bd-9028-d9a6e51bab67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:14.802987 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6e459266-7d60-44bd-9028-d9a6e51bab67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:14.803795 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6e459266-7d60-44bd-9028-d9a6e51bab67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:14.804219 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6e459266-7d60-44bd-9028-d9a6e51bab67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:14.929113 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6e459266-7d60-44bd-9028-d9a6e51bab67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:14.936439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6e459266-7d60-44bd-9028-d9a6e51bab67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.145069 Jun 15 15:56:14.936993 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 321/631] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:14 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:15.953362 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fea892b8-1181-433d-9ed6-ce6803aa74bb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:15.953999 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fea892b8-1181-433d-9ed6-ce6803aa74bb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:15.960595 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fea892b8-1181-433d-9ed6-ce6803aa74bb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:15.961044 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fea892b8-1181-433d-9ed6-ce6803aa74bb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:15.961807 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fea892b8-1181-433d-9ed6-ce6803aa74bb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:15.962240 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fea892b8-1181-433d-9ed6-ce6803aa74bb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:16.092080 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fea892b8-1181-433d-9ed6-ce6803aa74bb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:16.099527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fea892b8-1181-433d-9ed6-ce6803aa74bb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.150072 Jun 15 15:56:16.100627 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 311/632] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:15 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:17.117660 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6d5a2671-0ebc-476c-a273-b709b892f51a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:17.118273 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6d5a2671-0ebc-476c-a273-b709b892f51a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:17.124841 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6d5a2671-0ebc-476c-a273-b709b892f51a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:17.125302 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6d5a2671-0ebc-476c-a273-b709b892f51a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:17.126076 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6d5a2671-0ebc-476c-a273-b709b892f51a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:17.126511 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6d5a2671-0ebc-476c-a273-b709b892f51a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:17.259106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6d5a2671-0ebc-476c-a273-b709b892f51a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:17.266458 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6d5a2671-0ebc-476c-a273-b709b892f51a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.153265 Jun 15 15:56:17.267069 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 322/633] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:17 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:17.482541 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c4750641-b121-4535-9948-ac8d2cc2f3db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:17.483577 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c4750641-b121-4535-9948-ac8d2cc2f3db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:17.490098 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c4750641-b121-4535-9948-ac8d2cc2f3db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:17.490543 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c4750641-b121-4535-9948-ac8d2cc2f3db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:17.491324 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c4750641-b121-4535-9948-ac8d2cc2f3db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:17.491762 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c4750641-b121-4535-9948-ac8d2cc2f3db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:17.513572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-c4750641-b121-4535-9948-ac8d2cc2f3db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lazy-loading 'flavor' on Instance uuid 76bb4599-da4d-40fb-8de1-12edf17a8384 {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:56:17.634542 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c4750641-b121-4535-9948-ac8d2cc2f3db tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "POST /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/action" status: 200 len: 32 microversion: 2.1 time: 0.155931 Jun 15 15:56:17.635101 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 312/634] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 15:56:17 2022] POST /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:56:17.644197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d971b099-21da-4963-a944-e06af162cd90 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:17.644792 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d971b099-21da-4963-a944-e06af162cd90 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:17.651376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d971b099-21da-4963-a944-e06af162cd90 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:17.651945 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d971b099-21da-4963-a944-e06af162cd90 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:17.652909 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d971b099-21da-4963-a944-e06af162cd90 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:17.653365 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d971b099-21da-4963-a944-e06af162cd90 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:17.784761 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d971b099-21da-4963-a944-e06af162cd90 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:17.792970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d971b099-21da-4963-a944-e06af162cd90 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.152520 Jun 15 15:56:17.793538 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 323/635] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:17 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:18.284558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-33d18d46-890a-4442-9037-bfaaf5787028 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:18.285259 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-33d18d46-890a-4442-9037-bfaaf5787028 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:18.291741 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33d18d46-890a-4442-9037-bfaaf5787028 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:18.292192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33d18d46-890a-4442-9037-bfaaf5787028 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:18.292954 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33d18d46-890a-4442-9037-bfaaf5787028 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:18.293388 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33d18d46-890a-4442-9037-bfaaf5787028 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:18.420640 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-33d18d46-890a-4442-9037-bfaaf5787028 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:18.428769 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-33d18d46-890a-4442-9037-bfaaf5787028 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.147846 Jun 15 15:56:18.429275 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 313/636] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:18 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:18.810172 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3ff341fb-739f-41ed-afa7-80bff6ad2475 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:18.810772 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3ff341fb-739f-41ed-afa7-80bff6ad2475 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:18.817214 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3ff341fb-739f-41ed-afa7-80bff6ad2475 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:18.817663 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3ff341fb-739f-41ed-afa7-80bff6ad2475 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:18.818419 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3ff341fb-739f-41ed-afa7-80bff6ad2475 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:18.820996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3ff341fb-739f-41ed-afa7-80bff6ad2475 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:18.943308 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3ff341fb-739f-41ed-afa7-80bff6ad2475 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:18.951824 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3ff341fb-739f-41ed-afa7-80bff6ad2475 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.145652 Jun 15 15:56:18.952385 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 324/637] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:18 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:19.445567 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b2462901-664e-48f4-8965-5dcae9db9b88 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:19.446305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b2462901-664e-48f4-8965-5dcae9db9b88 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:19.452869 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b2462901-664e-48f4-8965-5dcae9db9b88 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:19.453318 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b2462901-664e-48f4-8965-5dcae9db9b88 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:19.454081 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b2462901-664e-48f4-8965-5dcae9db9b88 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:19.454521 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b2462901-664e-48f4-8965-5dcae9db9b88 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:19.581763 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b2462901-664e-48f4-8965-5dcae9db9b88 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:19.589695 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b2462901-664e-48f4-8965-5dcae9db9b88 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1677 microversion: 2.1 time: 0.148275 Jun 15 15:56:19.590261 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 314/638] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:19 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:19.968631 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7c03ab1f-fb86-40af-8608-2afc3f2b5e4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:19.969238 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7c03ab1f-fb86-40af-8608-2afc3f2b5e4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:19.976157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c03ab1f-fb86-40af-8608-2afc3f2b5e4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:19.976609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c03ab1f-fb86-40af-8608-2afc3f2b5e4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:19.977366 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c03ab1f-fb86-40af-8608-2afc3f2b5e4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:19.977798 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c03ab1f-fb86-40af-8608-2afc3f2b5e4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:20.108463 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7c03ab1f-fb86-40af-8608-2afc3f2b5e4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:20.116936 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7c03ab1f-fb86-40af-8608-2afc3f2b5e4a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.152157 Jun 15 15:56:20.117489 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 325/639] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:19 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:20.607037 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-96afd861-f7f2-46e3-a3fe-8c8f093798d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:20.607672 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-96afd861-f7f2-46e3-a3fe-8c8f093798d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:20.614111 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96afd861-f7f2-46e3-a3fe-8c8f093798d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:20.614559 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96afd861-f7f2-46e3-a3fe-8c8f093798d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:20.615367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96afd861-f7f2-46e3-a3fe-8c8f093798d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:20.616387 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-96afd861-f7f2-46e3-a3fe-8c8f093798d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:20.747935 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-96afd861-f7f2-46e3-a3fe-8c8f093798d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:20.755475 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-96afd861-f7f2-46e3-a3fe-8c8f093798d3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1654 microversion: 2.1 time: 0.152391 Jun 15 15:56:20.756038 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 315/640] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:20 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:20.771858 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-33573039-57cf-43e9-842a-e5d21d3f0002 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:20.777831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33573039-57cf-43e9-842a-e5d21d3f0002 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:20.778273 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33573039-57cf-43e9-842a-e5d21d3f0002 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:20.836432 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-33573039-57cf-43e9-842a-e5d21d3f0002 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Going to try to start instance {{(pid=123934) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 15 15:56:20.877504 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-33573039-57cf-43e9-842a-e5d21d3f0002 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "POST /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/action" status: 202 len: 0 microversion: 2.1 time: 0.109403 Jun 15 15:56:20.878098 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 326/641] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 15:56:20 2022] POST /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 15:56:20.886950 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9fc40a41-1428-4ef6-b561-5d8606cb5fd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:20.887642 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9fc40a41-1428-4ef6-b561-5d8606cb5fd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:20.893900 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9fc40a41-1428-4ef6-b561-5d8606cb5fd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:20.894367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9fc40a41-1428-4ef6-b561-5d8606cb5fd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:20.895329 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9fc40a41-1428-4ef6-b561-5d8606cb5fd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:20.895767 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9fc40a41-1428-4ef6-b561-5d8606cb5fd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:21.027310 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9fc40a41-1428-4ef6-b561-5d8606cb5fd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:21.034930 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9fc40a41-1428-4ef6-b561-5d8606cb5fd2 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1663 microversion: 2.1 time: 0.152508 Jun 15 15:56:21.035486 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 316/642] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:20 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:21.135092 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4d925545-19b2-4111-a580-74f87d9c26d5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:21.135788 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4d925545-19b2-4111-a580-74f87d9c26d5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:21.141908 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4d925545-19b2-4111-a580-74f87d9c26d5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:21.142356 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4d925545-19b2-4111-a580-74f87d9c26d5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:21.143209 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4d925545-19b2-4111-a580-74f87d9c26d5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:21.143644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4d925545-19b2-4111-a580-74f87d9c26d5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:21.278054 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4d925545-19b2-4111-a580-74f87d9c26d5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:21.286251 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4d925545-19b2-4111-a580-74f87d9c26d5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.156195 Jun 15 15:56:21.286839 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 327/643] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:21 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:22.053077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1d5217b5-a405-4112-a8af-70cd4a8487e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:22.053683 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1d5217b5-a405-4112-a8af-70cd4a8487e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:22.060767 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d5217b5-a405-4112-a8af-70cd4a8487e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:22.061211 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d5217b5-a405-4112-a8af-70cd4a8487e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:22.061960 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d5217b5-a405-4112-a8af-70cd4a8487e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:22.062389 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1d5217b5-a405-4112-a8af-70cd4a8487e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:22.066453 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:22.190667 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1d5217b5-a405-4112-a8af-70cd4a8487e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:22.198165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1d5217b5-a405-4112-a8af-70cd4a8487e3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1663 microversion: 2.1 time: 0.148955 Jun 15 15:56:22.198755 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 317/644] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:22 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:22.303528 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a07ff210-d3ff-47eb-a88f-94c1feeb7fab tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:22.304221 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a07ff210-d3ff-47eb-a88f-94c1feeb7fab tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:22.311691 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a07ff210-d3ff-47eb-a88f-94c1feeb7fab tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:22.312141 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a07ff210-d3ff-47eb-a88f-94c1feeb7fab tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:22.312892 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a07ff210-d3ff-47eb-a88f-94c1feeb7fab tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:22.313324 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a07ff210-d3ff-47eb-a88f-94c1feeb7fab tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:22.438305 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a07ff210-d3ff-47eb-a88f-94c1feeb7fab tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:22.446195 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a07ff210-d3ff-47eb-a88f-94c1feeb7fab tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.146467 Jun 15 15:56:22.446995 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 328/645] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:22 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:23.215867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5525267d-fc09-435c-9136-e0fd433f18b4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:23.216476 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5525267d-fc09-435c-9136-e0fd433f18b4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:23.223007 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5525267d-fc09-435c-9136-e0fd433f18b4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:23.223454 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5525267d-fc09-435c-9136-e0fd433f18b4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:23.224214 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5525267d-fc09-435c-9136-e0fd433f18b4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:23.224655 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5525267d-fc09-435c-9136-e0fd433f18b4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:23.354624 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5525267d-fc09-435c-9136-e0fd433f18b4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:23.362084 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5525267d-fc09-435c-9136-e0fd433f18b4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1667 microversion: 2.1 time: 0.150086 Jun 15 15:56:23.362644 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 318/646] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:23 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:56:23.463758 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-33c05aa0-2ae5-4eaf-a623-8c0546052696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:23.464357 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-33c05aa0-2ae5-4eaf-a623-8c0546052696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:23.470871 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33c05aa0-2ae5-4eaf-a623-8c0546052696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:23.471236 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33c05aa0-2ae5-4eaf-a623-8c0546052696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:23.471981 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33c05aa0-2ae5-4eaf-a623-8c0546052696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:23.472406 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33c05aa0-2ae5-4eaf-a623-8c0546052696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:23.597783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-33c05aa0-2ae5-4eaf-a623-8c0546052696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:23.601351 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:23.606751 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-33c05aa0-2ae5-4eaf-a623-8c0546052696 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.147348 Jun 15 15:56:23.607325 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 329/647] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:23 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:24.623385 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-037b9368-7f0e-434c-b85f-2928b4354dfd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:24.623993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-037b9368-7f0e-434c-b85f-2928b4354dfd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:24.630568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-037b9368-7f0e-434c-b85f-2928b4354dfd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:24.631054 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-037b9368-7f0e-434c-b85f-2928b4354dfd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:24.631819 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-037b9368-7f0e-434c-b85f-2928b4354dfd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:24.632767 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-037b9368-7f0e-434c-b85f-2928b4354dfd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:24.761314 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-037b9368-7f0e-434c-b85f-2928b4354dfd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:24.769281 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-037b9368-7f0e-434c-b85f-2928b4354dfd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.149741 Jun 15 15:56:24.769846 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 319/648] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:24 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:25.787171 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3827f917-d835-40e1-a034-e405199d53ea tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:25.787781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3827f917-d835-40e1-a034-e405199d53ea tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:25.796387 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3827f917-d835-40e1-a034-e405199d53ea tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:25.796835 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3827f917-d835-40e1-a034-e405199d53ea tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:25.797598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3827f917-d835-40e1-a034-e405199d53ea tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:25.798029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3827f917-d835-40e1-a034-e405199d53ea tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:25.924424 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3827f917-d835-40e1-a034-e405199d53ea tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:25.933100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3827f917-d835-40e1-a034-e405199d53ea tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.149943 Jun 15 15:56:25.933608 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 330/649] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:25 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:26.949775 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2a6243c4-2942-46b2-b07d-e022b382d846 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:26.950395 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2a6243c4-2942-46b2-b07d-e022b382d846 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:26.957277 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a6243c4-2942-46b2-b07d-e022b382d846 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:26.957728 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a6243c4-2942-46b2-b07d-e022b382d846 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:26.958521 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a6243c4-2942-46b2-b07d-e022b382d846 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:26.958980 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2a6243c4-2942-46b2-b07d-e022b382d846 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:27.085002 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2a6243c4-2942-46b2-b07d-e022b382d846 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:27.092944 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2a6243c4-2942-46b2-b07d-e022b382d846 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.147515 Jun 15 15:56:27.093512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 320/650] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:26 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:27.174192 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a453742a-5636-4b79-9694-76e1b670257d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:27.174701 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a453742a-5636-4b79-9694-76e1b670257d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:27.181115 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a453742a-5636-4b79-9694-76e1b670257d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:27.181553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a453742a-5636-4b79-9694-76e1b670257d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:27.182298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a453742a-5636-4b79-9694-76e1b670257d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:27.182755 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a453742a-5636-4b79-9694-76e1b670257d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:27.205258 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a453742a-5636-4b79-9694-76e1b670257d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b/ips" status: 200 len: 148 microversion: 2.1 time: 0.134048 Jun 15 15:56:27.205746 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 331/651] 10.222.0.62 () {58 vars in 1247 bytes} [Wed Jun 15 15:56:27 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b/ips => generated 148 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:56:27.217279 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-dc4ea216-3530-4f08-8540-a22c41e5eba1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7a1f700-966d-471b-a902-b982c2cbf4c8"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:27.218411 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-dc4ea216-3530-4f08-8540-a22c41e5eba1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:27.224462 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dc4ea216-3530-4f08-8540-a22c41e5eba1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:27.224908 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dc4ea216-3530-4f08-8540-a22c41e5eba1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:27.225672 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dc4ea216-3530-4f08-8540-a22c41e5eba1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:27.226103 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dc4ea216-3530-4f08-8540-a22c41e5eba1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:27.303355 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-dc4ea216-3530-4f08-8540-a22c41e5eba1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Invalid volume: volume e7a1f700-966d-471b-a902-b982c2cbf4c8 is already attached to instances: caa56f23-7713-4cc8-936c-b4f47a8506aa Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-dc4ea216-3530-4f08-8540-a22c41e5eba1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: POST /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b/os-volume_attachments HTTP/1.1 Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 74 Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:56:27.305186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {"volumeAttachment": {"volumeId": "e7a1f700-966d-471b-a902-b982c2cbf4c8"}} Jun 15 15:56:27.307192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Invalid volume: volume e7a1f700-966d-471b-a902-b982c2cbf4c8 is already attached to instances: caa56f23-7713-4cc8-936c-b4f47a8506aa Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'server_id': '4e3418e7-7db0-4525-93e2-9646dde34b8b', 'body': {'volumeAttachment': {'volumeId': 'e7a1f700-966d-471b-a902-b982c2cbf4c8'}}} Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e7a1f700-966d-471b-a902-b982c2cbf4c8 is already attached to instances: caa56f23-7713-4cc8-936c-b4f47a8506aa Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:56:27.308015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e7a1f700-966d-471b-a902-b982c2cbf4c8 is already attached to instances: caa56f23-7713-4cc8-936c-b4f47a8506aa Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:27.309496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:56:27.310993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:56:27.310993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:56:27.310993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:56:27.310993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e7a1f700-966d-471b-a902-b982c2cbf4c8 is already attached to instances: caa56f23-7713-4cc8-936c-b4f47a8506aa Jun 15 15:56:27.310993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:56:27.310993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-dc4ea216-3530-4f08-8540-a22c41e5eba1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 400 to user: Invalid volume: volume e7a1f700-966d-471b-a902-b982c2cbf4c8 is already attached to instances: caa56f23-7713-4cc8-936c-b4f47a8506aa {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:56:27.310993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-dc4ea216-3530-4f08-8540-a22c41e5eba1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094010 Jun 15 15:56:27.310993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 321/652] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 15:56:27 2022] POST /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:56:27.316718 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b4fffc95-4364-4e0f-9960-6391a1e4bb83 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:27.317214 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b4fffc95-4364-4e0f-9960-6391a1e4bb83 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:27.323596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b4fffc95-4364-4e0f-9960-6391a1e4bb83 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:27.324044 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b4fffc95-4364-4e0f-9960-6391a1e4bb83 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:27.324799 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b4fffc95-4364-4e0f-9960-6391a1e4bb83 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:27.325230 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b4fffc95-4364-4e0f-9960-6391a1e4bb83 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:27.349199 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b4fffc95-4364-4e0f-9960-6391a1e4bb83 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Going to try to terminate instance {{(pid=123934) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:56:27.421748 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b4fffc95-4364-4e0f-9960-6391a1e4bb83 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 204 len: 0 microversion: 2.1 time: 0.108985 Jun 15 15:56:27.422300 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 332/653] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:56:27 2022] DELETE /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:56:27.431575 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8b1dff65-7ed2-4d7a-a4f1-04b1a90663bb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:27.432189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-8b1dff65-7ed2-4d7a-a4f1-04b1a90663bb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:27.439188 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8b1dff65-7ed2-4d7a-a4f1-04b1a90663bb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:27.439635 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8b1dff65-7ed2-4d7a-a4f1-04b1a90663bb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:27.440399 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8b1dff65-7ed2-4d7a-a4f1-04b1a90663bb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:27.440832 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8b1dff65-7ed2-4d7a-a4f1-04b1a90663bb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:27.570908 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8b1dff65-7ed2-4d7a-a4f1-04b1a90663bb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:27.578574 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-8b1dff65-7ed2-4d7a-a4f1-04b1a90663bb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1680 microversion: 2.1 time: 0.151615 Jun 15 15:56:27.579167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 322/654] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:27 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:56:28.109991 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d4c6da6c-5478-4347-9ab7-cd84df7650d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:28.110670 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d4c6da6c-5478-4347-9ab7-cd84df7650d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:28.117067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4c6da6c-5478-4347-9ab7-cd84df7650d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:28.117505 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4c6da6c-5478-4347-9ab7-cd84df7650d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:28.118246 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4c6da6c-5478-4347-9ab7-cd84df7650d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:28.118668 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4c6da6c-5478-4347-9ab7-cd84df7650d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:28.244085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d4c6da6c-5478-4347-9ab7-cd84df7650d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:28.251878 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d4c6da6c-5478-4347-9ab7-cd84df7650d2 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.146106 Jun 15 15:56:28.252439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 333/655] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:28 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:28.595611 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fab8208e-2bc8-4a25-a337-0336c058746c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:28.596224 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fab8208e-2bc8-4a25-a337-0336c058746c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:28.602835 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fab8208e-2bc8-4a25-a337-0336c058746c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:28.603288 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fab8208e-2bc8-4a25-a337-0336c058746c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:28.604057 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fab8208e-2bc8-4a25-a337-0336c058746c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:28.604488 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fab8208e-2bc8-4a25-a337-0336c058746c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:28.741582 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fab8208e-2bc8-4a25-a337-0336c058746c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:28.749426 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fab8208e-2bc8-4a25-a337-0336c058746c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1680 microversion: 2.1 time: 0.157787 Jun 15 15:56:28.749974 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 323/656] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:28 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:29.268741 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ccda5c22-078e-42f4-aae4-2c1497b7624a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:29.269372 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ccda5c22-078e-42f4-aae4-2c1497b7624a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:29.276302 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ccda5c22-078e-42f4-aae4-2c1497b7624a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:29.276748 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ccda5c22-078e-42f4-aae4-2c1497b7624a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:29.277497 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ccda5c22-078e-42f4-aae4-2c1497b7624a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:29.277926 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ccda5c22-078e-42f4-aae4-2c1497b7624a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:29.410897 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ccda5c22-078e-42f4-aae4-2c1497b7624a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:29.419364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ccda5c22-078e-42f4-aae4-2c1497b7624a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.154437 Jun 15 15:56:29.419929 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 334/657] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:29 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:56:29.767431 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-10eccd93-be84-45f5-9dab-9f69eda9de56 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:29.768046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-10eccd93-be84-45f5-9dab-9f69eda9de56 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:29.775263 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-10eccd93-be84-45f5-9dab-9f69eda9de56 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:29.775716 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-10eccd93-be84-45f5-9dab-9f69eda9de56 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:29.776478 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-10eccd93-be84-45f5-9dab-9f69eda9de56 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:29.776907 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-10eccd93-be84-45f5-9dab-9f69eda9de56 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:29.906718 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-10eccd93-be84-45f5-9dab-9f69eda9de56 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:29.914486 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-10eccd93-be84-45f5-9dab-9f69eda9de56 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1680 microversion: 2.1 time: 0.150911 Jun 15 15:56:29.915060 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 324/658] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:29 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:30.412767 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-7956035d-511f-4a34-a8f1-fa7abc101868 req-2d952760-790c-431b-9b68-3a79c8b00dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3418e7-7db0-4525-93e2-9646dde34b8b", "name": "network-vif-deleted", "tag": "61559de7-75c9-4a3b-a009-2e5b844c72b0"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:30.422333 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-7956035d-511f-4a34-a8f1-fa7abc101868 req-2d952760-790c-431b-9b68-3a79c8b00dc0 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:30.422801 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-7956035d-511f-4a34-a8f1-fa7abc101868 req-2d952760-790c-431b-9b68-3a79c8b00dc0 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:30.439176 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f68145e9-d0b4-4592-96a0-80ec1bfc61a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:30.439799 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f68145e9-d0b4-4592-96a0-80ec1bfc61a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:30.443259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-7956035d-511f-4a34-a8f1-fa7abc101868 req-2d952760-790c-431b-9b68-3a79c8b00dc0 service nova] Creating event network-vif-deleted:61559de7-75c9-4a3b-a009-2e5b844c72b0 for instance 4e3418e7-7db0-4525-93e2-9646dde34b8b on hv-cinder-84599 Jun 15 15:56:30.448834 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f68145e9-d0b4-4592-96a0-80ec1bfc61a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:30.448834 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f68145e9-d0b4-4592-96a0-80ec1bfc61a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:30.448834 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f68145e9-d0b4-4592-96a0-80ec1bfc61a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:30.448834 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f68145e9-d0b4-4592-96a0-80ec1bfc61a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:30.453645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-7956035d-511f-4a34-a8f1-fa7abc101868 req-2d952760-790c-431b-9b68-3a79c8b00dc0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098163 Jun 15 15:56:30.456213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 335/659] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:30.585019 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f68145e9-d0b4-4592-96a0-80ec1bfc61a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:30.592939 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f68145e9-d0b4-4592-96a0-80ec1bfc61a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.159930 Jun 15 15:56:30.593510 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 325/660] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:30 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:30.932190 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9cea18ab-bf73-4bc1-99e8-db835f9407be tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:30.933052 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9cea18ab-bf73-4bc1-99e8-db835f9407be tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:30.939972 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9cea18ab-bf73-4bc1-99e8-db835f9407be tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:30.940450 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9cea18ab-bf73-4bc1-99e8-db835f9407be tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:30.941241 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9cea18ab-bf73-4bc1-99e8-db835f9407be tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:30.942270 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9cea18ab-bf73-4bc1-99e8-db835f9407be tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:31.006624 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-9cea18ab-bf73-4bc1-99e8-db835f9407be tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:31.015145 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9cea18ab-bf73-4bc1-99e8-db835f9407be tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1613 microversion: 2.1 time: 0.087072 Jun 15 15:56:31.015714 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 336/661] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:30 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:31.610653 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ddbf886b-40ff-45dc-9e2b-39a4e8787d1a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:31.611283 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ddbf886b-40ff-45dc-9e2b-39a4e8787d1a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:31.618537 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ddbf886b-40ff-45dc-9e2b-39a4e8787d1a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:31.619005 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ddbf886b-40ff-45dc-9e2b-39a4e8787d1a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:31.619771 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ddbf886b-40ff-45dc-9e2b-39a4e8787d1a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:31.620195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ddbf886b-40ff-45dc-9e2b-39a4e8787d1a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:31.762264 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ddbf886b-40ff-45dc-9e2b-39a4e8787d1a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:31.771239 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ddbf886b-40ff-45dc-9e2b-39a4e8787d1a tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.164363 Jun 15 15:56:31.782033 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 326/662] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:31 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:32.031929 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c3324615-3914-4632-93d3-3f8fe7300aea tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:32.032534 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c3324615-3914-4632-93d3-3f8fe7300aea tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:32.039763 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c3324615-3914-4632-93d3-3f8fe7300aea tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:32.040205 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c3324615-3914-4632-93d3-3f8fe7300aea tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:32.040955 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c3324615-3914-4632-93d3-3f8fe7300aea tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:32.041382 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c3324615-3914-4632-93d3-3f8fe7300aea tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:32.071248 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c3324615-3914-4632-93d3-3f8fe7300aea tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:32.071683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c3324615-3914-4632-93d3-3f8fe7300aea tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:32.072117 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-c3324615-3914-4632-93d3-3f8fe7300aea tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lazy-loading 'fault' on Instance uuid 4e3418e7-7db0-4525-93e2-9646dde34b8b {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:56:32.112375 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c3324615-3914-4632-93d3-3f8fe7300aea tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:32.120560 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c3324615-3914-4632-93d3-3f8fe7300aea tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 200 len: 1332 microversion: 2.1 time: 0.092477 Jun 15 15:56:32.123071 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 337/663] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:32 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:32.789045 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-52838061-166b-47dd-ad93-2cfd2da1b4a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:32.790133 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-52838061-166b-47dd-ad93-2cfd2da1b4a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:32.796556 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-52838061-166b-47dd-ad93-2cfd2da1b4a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:32.796996 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-52838061-166b-47dd-ad93-2cfd2da1b4a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:32.797745 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-52838061-166b-47dd-ad93-2cfd2da1b4a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:32.798169 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-52838061-166b-47dd-ad93-2cfd2da1b4a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:32.923073 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-52838061-166b-47dd-ad93-2cfd2da1b4a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:32.930963 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-52838061-166b-47dd-ad93-2cfd2da1b4a0 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1735 microversion: 2.1 time: 0.146003 Jun 15 15:56:32.931518 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 327/664] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:32 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:33.137275 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7222204c-97b5-46f6-93f9-213f0ff04d31 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:33.137883 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7222204c-97b5-46f6-93f9-213f0ff04d31 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:33.140331 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:33.145645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7222204c-97b5-46f6-93f9-213f0ff04d31 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:33.146089 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7222204c-97b5-46f6-93f9-213f0ff04d31 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:33.146877 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7222204c-97b5-46f6-93f9-213f0ff04d31 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:33.147312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7222204c-97b5-46f6-93f9-213f0ff04d31 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:33.162128 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-7222204c-97b5-46f6-93f9-213f0ff04d31 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7222204c-97b5-46f6-93f9-213f0ff04d31 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b HTTP/1.1 Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:56:33.163757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 15:56:33.165867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '4e3418e7-7db0-4525-93e2-9646dde34b8b'} Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:56:33.166676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 15:56:33.167901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:33.169005 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7222204c-97b5-46f6-93f9-213f0ff04d31 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:56:33.169005 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7222204c-97b5-46f6-93f9-213f0ff04d31 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 404 len: 111 microversion: 2.1 time: 0.032263 Jun 15 15:56:33.169005 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 338/665] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:33 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:56:33.174534 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e227fc94-f931-4a62-b39d-3cc2b80cd591 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '.version_select at 0x7fd8d808edc0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:33.177713 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e227fc94-f931-4a62-b39d-3cc2b80cd591 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [f439402d-b874-40e2-bcfe-241f1d1a77b0] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 15 15:56:33.947745 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f3389efa-a5db-4e67-ad62-dbf2e2f6c799 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:33.948384 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f3389efa-a5db-4e67-ad62-dbf2e2f6c799 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:33.954350 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f3389efa-a5db-4e67-ad62-dbf2e2f6c799 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:33.954830 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f3389efa-a5db-4e67-ad62-dbf2e2f6c799 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:33.955590 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f3389efa-a5db-4e67-ad62-dbf2e2f6c799 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:33.956024 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f3389efa-a5db-4e67-ad62-dbf2e2f6c799 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:34.084279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f3389efa-a5db-4e67-ad62-dbf2e2f6c799 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:34.092856 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f3389efa-a5db-4e67-ad62-dbf2e2f6c799 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1715 microversion: 2.1 time: 0.148957 Jun 15 15:56:34.093412 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 339/666] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:33 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1715 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:56:34.188977 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO oslo.messaging._drivers.impl_rabbit [None req-e227fc94-f931-4a62-b39d-3cc2b80cd591 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [f439402d-b874-40e2-bcfe-241f1d1a77b0] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 39054. Jun 15 15:56:34.192715 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-09c8af67-f05a-464d-b751-598a38c8772b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:34.193234 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-09c8af67-f05a-464d-b751-598a38c8772b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:34.200117 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-09c8af67-f05a-464d-b751-598a38c8772b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:34.200559 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-09c8af67-f05a-464d-b751-598a38c8772b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:34.201306 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-09c8af67-f05a-464d-b751-598a38c8772b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:34.201730 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-09c8af67-f05a-464d-b751-598a38c8772b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:34.208192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e227fc94-f931-4a62-b39d-3cc2b80cd591 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825631026" status: 202 len: 0 microversion: 2.1 time: 1.037458 Jun 15 15:56:34.208783 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 328/667] 10.222.0.62 () {58 vars in 1220 bytes} [Wed Jun 15 15:56:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825631026 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:56:34.283233 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-09c8af67-f05a-464d-b751-598a38c8772b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] HTTP exception thrown: Cannot 'detach_volume' instance 76bb4599-da4d-40fb-8de1-12edf17a8384 while it is in vm_state rescued Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-09c8af67-f05a-464d-b751-598a38c8772b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Request method failure captured: Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: DELETE /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments/c99c8b13-3325-46d5-bf69-d34e23fdf4b7 HTTP/1.1 Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgAJQGYAJRl8YAWSmPSJEUL1Wp7YSAiHsrjh_EXMN13v3eyGOsp6BU_oMpiZd_kBcb2W-N_OFZbXfOcG-E9Fe7UGbRxs58tZ0yj78Bxro6IajNJkFyo7U9X9tDlMEha8AfDpzXzhRvv4bGqRBMii-zprZbYrs-1yOxD_a7hzl3rsPAs Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: f2ed62f01ef846569c069e52fcfee36a Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:56:34.284762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:56:34.286584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f2ed62f01ef846569c069e52fcfee36a", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:56:34.286584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:56:34.286584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: f2ed62f01ef846569c069e52fcfee36a Jun 15 15:56:34.286584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:56:34.286584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-ServerRescueNegativeTestJSON-579752165-project Jun 15 15:56:34.286584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:56:34.286584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:56:34.286584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: f8fcb09990db433e8ac0af3de37bdbc7 Jun 15 15:56:34.286584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-ServerRescueNegativeTestJSON-579752165-project Jun 15 15:56:34.286584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:56:34.286584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Cannot 'detach_volume' instance 76bb4599-da4d-40fb-8de1-12edf17a8384 while it is in vm_state rescued Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'server_id': '76bb4599-da4d-40fb-8de1-12edf17a8384', 'id': 'c99c8b13-3325-46d5-bf69-d34e23fdf4b7'} Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76bb4599-da4d-40fb-8de1-12edf17a8384 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:56:34.287413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 76bb4599-da4d-40fb-8de1-12edf17a8384 while it is in vm_state rescued Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 76bb4599-da4d-40fb-8de1-12edf17a8384 while it is in vm_state rescued Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:34.288813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-09c8af67-f05a-464d-b751-598a38c8772b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Returning 409 to user: Cannot 'detach_volume' instance 76bb4599-da4d-40fb-8de1-12edf17a8384 while it is in vm_state rescued {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:56:34.290008 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-09c8af67-f05a-464d-b751-598a38c8772b tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "DELETE /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments/c99c8b13-3325-46d5-bf69-d34e23fdf4b7" status: 409 len: 152 microversion: 2.1 time: 0.097695 Jun 15 15:56:34.290008 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 340/668] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 15:56:34 2022] DELETE /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments/c99c8b13-3325-46d5-bf69-d34e23fdf4b7 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 15 15:56:34.295808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-91a5e7c1-fa02-4591-8faa-eba1e244e3b9 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:34.296402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-91a5e7c1-fa02-4591-8faa-eba1e244e3b9 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:34.298882 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:34.305043 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-91a5e7c1-fa02-4591-8faa-eba1e244e3b9 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:34.305560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-91a5e7c1-fa02-4591-8faa-eba1e244e3b9 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:34.306409 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-91a5e7c1-fa02-4591-8faa-eba1e244e3b9 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:34.307118 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-91a5e7c1-fa02-4591-8faa-eba1e244e3b9 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:34.392718 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-91a5e7c1-fa02-4591-8faa-eba1e244e3b9 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "POST /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/action" status: 202 len: 0 microversion: 2.1 time: 0.100932 Jun 15 15:56:34.393672 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 329/669] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 15:56:34 2022] POST /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:56:34.403191 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a556b5ed-ced3-43c7-905d-3cec819b3c55 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:34.404165 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a556b5ed-ced3-43c7-905d-3cec819b3c55 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:34.411190 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a556b5ed-ced3-43c7-905d-3cec819b3c55 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:34.411672 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a556b5ed-ced3-43c7-905d-3cec819b3c55 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:34.412662 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a556b5ed-ced3-43c7-905d-3cec819b3c55 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:34.413122 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a556b5ed-ced3-43c7-905d-3cec819b3c55 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:34.556316 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a556b5ed-ced3-43c7-905d-3cec819b3c55 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:34.564265 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a556b5ed-ced3-43c7-905d-3cec819b3c55 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1723 microversion: 2.1 time: 0.166299 Jun 15 15:56:34.564990 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 341/670] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:34 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:56:35.022541 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6018f880-c71d-45e5-9904-a7ba92e8ee58 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:35.023149 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6018f880-c71d-45e5-9904-a7ba92e8ee58 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:35.029441 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6018f880-c71d-45e5-9904-a7ba92e8ee58 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:35.029897 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6018f880-c71d-45e5-9904-a7ba92e8ee58 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:35.030663 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6018f880-c71d-45e5-9904-a7ba92e8ee58 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:35.031129 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6018f880-c71d-45e5-9904-a7ba92e8ee58 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:35.112357 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-6018f880-c71d-45e5-9904-a7ba92e8ee58 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lazy-loading 'services' on Instance uuid caa56f23-7713-4cc8-936c-b4f47a8506aa {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:56:35.185512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6018f880-c71d-45e5-9904-a7ba92e8ee58 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments/e7a1f700-966d-471b-a902-b982c2cbf4c8" status: 202 len: 0 microversion: 2.1 time: 0.167545 Jun 15 15:56:35.186103 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 330/671] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 15:56:35 2022] DELETE /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments/e7a1f700-966d-471b-a902-b982c2cbf4c8 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:56:35.194574 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-663470b2-e305-4325-91d4-39f1805dd2bc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:35.195677 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-663470b2-e305-4325-91d4-39f1805dd2bc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:35.202527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-663470b2-e305-4325-91d4-39f1805dd2bc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:35.203223 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-663470b2-e305-4325-91d4-39f1805dd2bc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:35.204094 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-663470b2-e305-4325-91d4-39f1805dd2bc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:35.204557 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-663470b2-e305-4325-91d4-39f1805dd2bc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:35.235498 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-663470b2-e305-4325-91d4-39f1805dd2bc tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044999 Jun 15 15:56:35.236065 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 342/672] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:56:35 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:35.581801 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fc270274-02f3-4c4f-99ae-b349c01cefd1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:35.582456 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fc270274-02f3-4c4f-99ae-b349c01cefd1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:35.588758 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc270274-02f3-4c4f-99ae-b349c01cefd1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:35.589208 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc270274-02f3-4c4f-99ae-b349c01cefd1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:35.589966 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc270274-02f3-4c4f-99ae-b349c01cefd1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:35.590399 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fc270274-02f3-4c4f-99ae-b349c01cefd1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:35.714580 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fc270274-02f3-4c4f-99ae-b349c01cefd1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:35.722471 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fc270274-02f3-4c4f-99ae-b349c01cefd1 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1723 microversion: 2.1 time: 0.145020 Jun 15 15:56:35.723062 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 331/673] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:35 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:36.247519 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-29f8f61c-3f7e-4f4f-9fde-79c2d620ded7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:36.248345 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-29f8f61c-3f7e-4f4f-9fde-79c2d620ded7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:36.254982 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-29f8f61c-3f7e-4f4f-9fde-79c2d620ded7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:36.255429 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-29f8f61c-3f7e-4f4f-9fde-79c2d620ded7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:36.256179 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-29f8f61c-3f7e-4f4f-9fde-79c2d620ded7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:36.256610 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-29f8f61c-3f7e-4f4f-9fde-79c2d620ded7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:36.285784 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-29f8f61c-3f7e-4f4f-9fde-79c2d620ded7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 Jun 15 15:56:36.286314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 343/674] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:56:36 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:36.739048 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-77f03609-c289-447f-a626-b60116923261 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:36.739655 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-77f03609-c289-447f-a626-b60116923261 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:36.746667 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-77f03609-c289-447f-a626-b60116923261 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:36.747145 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-77f03609-c289-447f-a626-b60116923261 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:36.747904 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-77f03609-c289-447f-a626-b60116923261 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:36.748339 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-77f03609-c289-447f-a626-b60116923261 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:36.874759 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-77f03609-c289-447f-a626-b60116923261 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:36.882670 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-77f03609-c289-447f-a626-b60116923261 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1723 microversion: 2.1 time: 0.147550 Jun 15 15:56:36.883810 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 332/675] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:36 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:37.297363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-527c7abd-910e-4e50-a456-2181a326329d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:37.298281 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-527c7abd-910e-4e50-a456-2181a326329d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:37.305349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-527c7abd-910e-4e50-a456-2181a326329d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:37.305856 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-527c7abd-910e-4e50-a456-2181a326329d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:37.306556 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-527c7abd-910e-4e50-a456-2181a326329d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:37.307012 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-527c7abd-910e-4e50-a456-2181a326329d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:37.335086 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-527c7abd-910e-4e50-a456-2181a326329d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041672 Jun 15 15:56:37.335636 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 344/676] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:56:37 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:37.957323 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5cd2a0ac-bfd0-4f7e-a1d0-6013a9b81746 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:37.957979 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5cd2a0ac-bfd0-4f7e-a1d0-6013a9b81746 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:37.964777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5cd2a0ac-bfd0-4f7e-a1d0-6013a9b81746 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:37.965208 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5cd2a0ac-bfd0-4f7e-a1d0-6013a9b81746 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:37.965968 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5cd2a0ac-bfd0-4f7e-a1d0-6013a9b81746 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:37.966423 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5cd2a0ac-bfd0-4f7e-a1d0-6013a9b81746 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:37.970589 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:38.098077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5cd2a0ac-bfd0-4f7e-a1d0-6013a9b81746 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:38.105976 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5cd2a0ac-bfd0-4f7e-a1d0-6013a9b81746 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1723 microversion: 2.1 time: 0.209703 Jun 15 15:56:38.106754 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 333/677] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:37 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:38.346334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c8be734c-9e0d-44cc-944b-e7ef4f4bd5d6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:38.347305 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c8be734c-9e0d-44cc-944b-e7ef4f4bd5d6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:38.354434 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c8be734c-9e0d-44cc-944b-e7ef4f4bd5d6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:38.354914 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c8be734c-9e0d-44cc-944b-e7ef4f4bd5d6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:38.355670 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c8be734c-9e0d-44cc-944b-e7ef4f4bd5d6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:38.356106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c8be734c-9e0d-44cc-944b-e7ef4f4bd5d6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:38.384049 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c8be734c-9e0d-44cc-944b-e7ef4f4bd5d6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041624 Jun 15 15:56:38.384585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 345/678] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:56:38 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:39.122510 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ea934176-696d-405c-bd93-e0d6504750b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:39.123141 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ea934176-696d-405c-bd93-e0d6504750b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:39.129634 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ea934176-696d-405c-bd93-e0d6504750b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:39.130085 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ea934176-696d-405c-bd93-e0d6504750b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:39.130877 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ea934176-696d-405c-bd93-e0d6504750b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:39.131318 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ea934176-696d-405c-bd93-e0d6504750b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:39.262344 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ea934176-696d-405c-bd93-e0d6504750b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:39.270206 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ea934176-696d-405c-bd93-e0d6504750b5 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1729 microversion: 2.1 time: 0.151574 Jun 15 15:56:39.270793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 334/679] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:39 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:39.287393 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9c11802c-73f2-4ed4-8d7f-b729bd1b8e42 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:39.287875 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9c11802c-73f2-4ed4-8d7f-b729bd1b8e42 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:39.293751 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9c11802c-73f2-4ed4-8d7f-b729bd1b8e42 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:39.294189 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9c11802c-73f2-4ed4-8d7f-b729bd1b8e42 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:39.294963 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9c11802c-73f2-4ed4-8d7f-b729bd1b8e42 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:39.295389 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9c11802c-73f2-4ed4-8d7f-b729bd1b8e42 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:39.298970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:39.375581 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9c11802c-73f2-4ed4-8d7f-b729bd1b8e42 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092190 Jun 15 15:56:39.376174 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 346/680] 10.222.0.62 () {58 vars in 1274 bytes} [Wed Jun 15 15:56:39 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:39.395382 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-53104dff-9545-45bd-b0c2-13b2087abca7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:39.396384 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-53104dff-9545-45bd-b0c2-13b2087abca7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:39.403023 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-53104dff-9545-45bd-b0c2-13b2087abca7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:39.403471 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-53104dff-9545-45bd-b0c2-13b2087abca7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:39.404231 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-53104dff-9545-45bd-b0c2-13b2087abca7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:39.404675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-53104dff-9545-45bd-b0c2-13b2087abca7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:39.436348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-53104dff-9545-45bd-b0c2-13b2087abca7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044776 Jun 15 15:56:39.441369 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 335/681] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:56:39 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:56:39.503685 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9e988ad1-000d-4ed5-9e73-25a970889b60 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:39.504265 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9e988ad1-000d-4ed5-9e73-25a970889b60 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:39.510916 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9e988ad1-000d-4ed5-9e73-25a970889b60 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:39.511437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9e988ad1-000d-4ed5-9e73-25a970889b60 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:39.512270 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9e988ad1-000d-4ed5-9e73-25a970889b60 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:39.512771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9e988ad1-000d-4ed5-9e73-25a970889b60 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:39.537898 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9e988ad1-000d-4ed5-9e73-25a970889b60 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Going to try to terminate instance {{(pid=123934) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:56:39.617269 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9e988ad1-000d-4ed5-9e73-25a970889b60 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 204 len: 0 microversion: 2.1 time: 0.117235 Jun 15 15:56:39.618031 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 347/682] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:56:39 2022] DELETE /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:56:39.628951 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4520d8fc-89f6-4b1e-b552-a58e04049b66 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:39.629477 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4520d8fc-89f6-4b1e-b552-a58e04049b66 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:39.635568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4520d8fc-89f6-4b1e-b552-a58e04049b66 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:39.636041 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4520d8fc-89f6-4b1e-b552-a58e04049b66 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:39.636798 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4520d8fc-89f6-4b1e-b552-a58e04049b66 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:39.637228 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4520d8fc-89f6-4b1e-b552-a58e04049b66 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:40.106910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4520d8fc-89f6-4b1e-b552-a58e04049b66 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:40.114778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4520d8fc-89f6-4b1e-b552-a58e04049b66 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1680 microversion: 2.1 time: 0.491549 Jun 15 15:56:40.115354 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 336/683] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:39 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1680 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:40.587902 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-57fb9a27-53b6-46c6-9528-2c630ee558a4 req-f738459c-a1ed-4595-b281-da3b1c3d2dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76bb4599-da4d-40fb-8de1-12edf17a8384", "tag": "a4dbc8ca-933e-46fd-9b4c-8dc00d37465e"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:40.596733 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-57fb9a27-53b6-46c6-9528-2c630ee558a4 req-f738459c-a1ed-4595-b281-da3b1c3d2dba service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:40.597181 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-57fb9a27-53b6-46c6-9528-2c630ee558a4 req-f738459c-a1ed-4595-b281-da3b1c3d2dba service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:40.608596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-57fb9a27-53b6-46c6-9528-2c630ee558a4 req-f738459c-a1ed-4595-b281-da3b1c3d2dba service nova] Creating event network-changed:a4dbc8ca-933e-46fd-9b4c-8dc00d37465e for instance 76bb4599-da4d-40fb-8de1-12edf17a8384 on hv-cinder-84599 Jun 15 15:56:40.613385 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-57fb9a27-53b6-46c6-9528-2c630ee558a4 req-f738459c-a1ed-4595-b281-da3b1c3d2dba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085326 Jun 15 15:56:40.613952 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 348/684] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:41.132492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b46cd5da-3205-4aad-a24e-0aa0050d2a8e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:41.133108 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b46cd5da-3205-4aad-a24e-0aa0050d2a8e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:41.140049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b46cd5da-3205-4aad-a24e-0aa0050d2a8e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:41.140505 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b46cd5da-3205-4aad-a24e-0aa0050d2a8e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:41.141278 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b46cd5da-3205-4aad-a24e-0aa0050d2a8e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:41.141714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b46cd5da-3205-4aad-a24e-0aa0050d2a8e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:41.375978 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b46cd5da-3205-4aad-a24e-0aa0050d2a8e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:41.385606 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b46cd5da-3205-4aad-a24e-0aa0050d2a8e tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1680 microversion: 2.1 time: 0.257406 Jun 15 15:56:41.395185 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 337/685] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:41 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1680 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:42.403449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-347a0355-a5fe-4071-84a4-8ab00179c73f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:42.404116 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-347a0355-a5fe-4071-84a4-8ab00179c73f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:42.411008 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-347a0355-a5fe-4071-84a4-8ab00179c73f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:42.411452 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-347a0355-a5fe-4071-84a4-8ab00179c73f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:42.412209 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-347a0355-a5fe-4071-84a4-8ab00179c73f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:42.412637 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-347a0355-a5fe-4071-84a4-8ab00179c73f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:42.445046 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-347a0355-a5fe-4071-84a4-8ab00179c73f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:42.445737 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-347a0355-a5fe-4071-84a4-8ab00179c73f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:42.446201 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-347a0355-a5fe-4071-84a4-8ab00179c73f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lazy-loading 'fault' on Instance uuid caa56f23-7713-4cc8-936c-b4f47a8506aa {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:56:42.489833 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-347a0355-a5fe-4071-84a4-8ab00179c73f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:42.498848 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-347a0355-a5fe-4071-84a4-8ab00179c73f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 200 len: 1331 microversion: 2.1 time: 0.099568 Jun 15 15:56:42.499537 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 349/686] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:42 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:42.628327 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-6d74d331-157b-4cdc-b732-eefdbe98930b req-3d4249e8-dac0-4a23-947a-98739023b8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76bb4599-da4d-40fb-8de1-12edf17a8384", "tag": "a4dbc8ca-933e-46fd-9b4c-8dc00d37465e"}, {"server_uuid": "caa56f23-7713-4cc8-936c-b4f47a8506aa", "name": "network-vif-deleted", "tag": "ce9ef32f-0f8b-4f92-af0e-f440f9f4f5a8"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:42.639641 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-6d74d331-157b-4cdc-b732-eefdbe98930b req-3d4249e8-dac0-4a23-947a-98739023b8c3 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:42.640078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-6d74d331-157b-4cdc-b732-eefdbe98930b req-3d4249e8-dac0-4a23-947a-98739023b8c3 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:42.653071 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-6d74d331-157b-4cdc-b732-eefdbe98930b req-3d4249e8-dac0-4a23-947a-98739023b8c3 service nova] Creating event network-changed:a4dbc8ca-933e-46fd-9b4c-8dc00d37465e for instance 76bb4599-da4d-40fb-8de1-12edf17a8384 on hv-cinder-84599 Jun 15 15:56:42.653599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-6d74d331-157b-4cdc-b732-eefdbe98930b req-3d4249e8-dac0-4a23-947a-98739023b8c3 service nova] Creating event network-vif-deleted:ce9ef32f-0f8b-4f92-af0e-f440f9f4f5a8 for instance caa56f23-7713-4cc8-936c-b4f47a8506aa on hv-cinder-84599 Jun 15 15:56:42.662066 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-6d74d331-157b-4cdc-b732-eefdbe98930b req-3d4249e8-dac0-4a23-947a-98739023b8c3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037939 Jun 15 15:56:42.663285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 338/687] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:43.516321 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-71e0891c-24d4-4d4a-8861-ed7a96a0efba tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:43.516926 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-71e0891c-24d4-4d4a-8861-ed7a96a0efba tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:43.523373 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-71e0891c-24d4-4d4a-8861-ed7a96a0efba tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:43.523817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-71e0891c-24d4-4d4a-8861-ed7a96a0efba tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:43.524568 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-71e0891c-24d4-4d4a-8861-ed7a96a0efba tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:43.524997 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-71e0891c-24d4-4d4a-8861-ed7a96a0efba tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:43.538151 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-71e0891c-24d4-4d4a-8861-ed7a96a0efba tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-71e0891c-24d4-4d4a-8861-ed7a96a0efba tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa HTTP/1.1 Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:56:43.539789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 15:56:43.541279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': 'caa56f23-7713-4cc8-936c-b4f47a8506aa'} Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:56:43.542143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 15:56:43.543565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:56:43.544800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-71e0891c-24d4-4d4a-8861-ed7a96a0efba tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:56:43.544800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-71e0891c-24d4-4d4a-8861-ed7a96a0efba tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 404 len: 111 microversion: 2.1 time: 0.028745 Jun 15 15:56:43.544800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 350/688] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:43 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:56:43.550355 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-45a71cab-0eb1-4940-b605-487d93a9794b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '.version_select at 0x7fd8d8055dc0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:43.567735 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-45a71cab-0eb1-4940-b605-487d93a9794b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-329052346" status: 202 len: 0 microversion: 2.1 time: 0.021475 Jun 15 15:56:43.568285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 339/689] 10.222.0.62 () {58 vars in 1217 bytes} [Wed Jun 15 15:56:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-329052346 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:56:43.989665 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:56:43.989858 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 15:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:56:44.198612 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5ea52786-71f0-4b83-b5f7-4607cf1b7ef8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: .version_select at 0x7fd8d82a7af0>, body: {"keypair": {"name": "tempest-keypair-785081587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8mI0O5vnxxEclcmjToSOjEI9B2poYtmqVE4uWDPacvIItcV4WLdeY6kiEDjda0Cteh2dwOs13p5B/sXEijeeJJ6OGyf9JI+D2qF+q0iEq8z6yKzTgeF65+Dj9lEDrVwQ=="}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:44.212771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-5ea52786-71f0-4b83-b5f7-4607cf1b7ef8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for project 0496c4ee9cdf486684000904876d0b6b. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:56:44.216786 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-5ea52786-71f0-4b83-b5f7-4607cf1b7ef8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for user fb838f931b7748e2baf6c2315d3cbd75 and project 0496c4ee9cdf486684000904876d0b6b. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:56:44.240888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5ea52786-71f0-4b83-b5f7-4607cf1b7ef8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046091 Jun 15 15:56:44.241404 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 351/690] 10.222.0.62 () {60 vars in 1158 bytes} [Wed Jun 15 15:56:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:45.655072 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-734798595", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "597f7e5d-558d-4aed-88e5-ecbc7c009bb7"}], "security_groups": [{"name": "tempest-securitygroup--949979048"}], "key_name": "tempest-keypair-785081587", "user_data": "}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:45.754925 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] validate_networks() for [('597f7e5d-558d-4aed-88e5-ecbc7c009bb7', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:56:46.208085 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:56:46.208566 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:56:46.209083 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:56:46.209491 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:56:46.209895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:56:46.219961 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:46.220398 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:46.221179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:46.221606 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:46.239223 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for project 0496c4ee9cdf486684000904876d0b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:56:46.243083 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for user fb838f931b7748e2baf6c2315d3cbd75 and project 0496c4ee9cdf486684000904876d0b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:56:46.253911 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:56:46.256259 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:56:46.302823 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-58c12437-f2b7-4bd2-8952-8a368fcea5af tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.653020 Jun 15 15:56:46.303402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 340/691] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:56:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:56:46.314863 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-40934795-b635-4947-a485-8e067fb9a865 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:46.315592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-40934795-b635-4947-a485-8e067fb9a865 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:46.373979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-40934795-b635-4947-a485-8e067fb9a865 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:46.380649 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-40934795-b635-4947-a485-8e067fb9a865 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1240 microversion: 2.1 time: 0.070568 Jun 15 15:56:46.381409 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 352/692] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:46 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:47.398248 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d1aa0600-ec49-4e1f-bef7-18bd57d3cfdd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:47.398890 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d1aa0600-ec49-4e1f-bef7-18bd57d3cfdd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:47.406426 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d1aa0600-ec49-4e1f-bef7-18bd57d3cfdd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:47.406892 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d1aa0600-ec49-4e1f-bef7-18bd57d3cfdd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:47.407687 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d1aa0600-ec49-4e1f-bef7-18bd57d3cfdd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:47.408121 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d1aa0600-ec49-4e1f-bef7-18bd57d3cfdd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:47.469115 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d1aa0600-ec49-4e1f-bef7-18bd57d3cfdd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:47.476453 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d1aa0600-ec49-4e1f-bef7-18bd57d3cfdd tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1292 microversion: 2.1 time: 0.082136 Jun 15 15:56:47.477008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 341/693] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:47 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1292 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:48.494433 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7d17ca33-ed95-439a-945c-f785a496eb7f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:48.495076 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7d17ca33-ed95-439a-945c-f785a496eb7f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:48.501469 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7d17ca33-ed95-439a-945c-f785a496eb7f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:48.501911 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7d17ca33-ed95-439a-945c-f785a496eb7f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:48.502658 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7d17ca33-ed95-439a-945c-f785a496eb7f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:48.503106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7d17ca33-ed95-439a-945c-f785a496eb7f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:48.578677 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7d17ca33-ed95-439a-945c-f785a496eb7f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:48.586049 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7d17ca33-ed95-439a-945c-f785a496eb7f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1298 microversion: 2.1 time: 0.096194 Jun 15 15:56:48.586601 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 353/694] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:48 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:49.357723 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-e297748b-c477-48f2-a614-1062464e1788 req-528af79e-bfb6-4c41-81f1-bd3557386348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfc8df9-5cac-41ce-8af4-47483c7b5d95", "tag": "874420e5-c070-43f3-99c3-c445ee22fedf"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:49.367683 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-e297748b-c477-48f2-a614-1062464e1788 req-528af79e-bfb6-4c41-81f1-bd3557386348 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:49.368956 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-e297748b-c477-48f2-a614-1062464e1788 req-528af79e-bfb6-4c41-81f1-bd3557386348 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:49.386448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-e297748b-c477-48f2-a614-1062464e1788 req-528af79e-bfb6-4c41-81f1-bd3557386348 service nova] Creating event network-changed:874420e5-c070-43f3-99c3-c445ee22fedf for instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 on hv-cinder-84599 Jun 15 15:56:49.391434 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-e297748b-c477-48f2-a614-1062464e1788 req-528af79e-bfb6-4c41-81f1-bd3557386348 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038559 Jun 15 15:56:49.392051 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 342/695] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:49.603800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5db70bbf-f8b4-47ae-acd0-48fcb6afb293 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:49.604327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5db70bbf-f8b4-47ae-acd0-48fcb6afb293 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:49.610751 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5db70bbf-f8b4-47ae-acd0-48fcb6afb293 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:49.611203 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5db70bbf-f8b4-47ae-acd0-48fcb6afb293 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:49.612331 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5db70bbf-f8b4-47ae-acd0-48fcb6afb293 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:49.612443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5db70bbf-f8b4-47ae-acd0-48fcb6afb293 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:50.036736 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5db70bbf-f8b4-47ae-acd0-48fcb6afb293 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:50.045423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5db70bbf-f8b4-47ae-acd0-48fcb6afb293 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1365 microversion: 2.1 time: 0.445490 Jun 15 15:56:50.045995 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 354/696] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:49 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1365 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:51.061926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ed557a25-516b-4919-8167-4335097ded74 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:51.062622 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ed557a25-516b-4919-8167-4335097ded74 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:51.069395 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ed557a25-516b-4919-8167-4335097ded74 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:51.069845 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ed557a25-516b-4919-8167-4335097ded74 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:51.070603 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ed557a25-516b-4919-8167-4335097ded74 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:51.071091 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ed557a25-516b-4919-8167-4335097ded74 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:51.201731 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ed557a25-516b-4919-8167-4335097ded74 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:51.209059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ed557a25-516b-4919-8167-4335097ded74 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1365 microversion: 2.1 time: 0.151388 Jun 15 15:56:51.209618 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 343/697] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:51 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:52.226508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-84ddc17a-3409-45cb-9568-ac62d805cf2d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:52.227036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-84ddc17a-3409-45cb-9568-ac62d805cf2d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:52.234125 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84ddc17a-3409-45cb-9568-ac62d805cf2d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:52.234572 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84ddc17a-3409-45cb-9568-ac62d805cf2d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:52.235360 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84ddc17a-3409-45cb-9568-ac62d805cf2d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:52.235793 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-84ddc17a-3409-45cb-9568-ac62d805cf2d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:52.363250 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-84ddc17a-3409-45cb-9568-ac62d805cf2d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:52.371202 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-84ddc17a-3409-45cb-9568-ac62d805cf2d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1365 microversion: 2.1 time: 0.148650 Jun 15 15:56:52.371760 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 355/698] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:52 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:53.388530 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a4b2effb-86b8-4544-8657-c40c36208019 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:53.389204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a4b2effb-86b8-4544-8657-c40c36208019 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:53.395671 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4b2effb-86b8-4544-8657-c40c36208019 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:53.396110 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4b2effb-86b8-4544-8657-c40c36208019 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:53.396886 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4b2effb-86b8-4544-8657-c40c36208019 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:53.397312 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4b2effb-86b8-4544-8657-c40c36208019 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:53.524704 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a4b2effb-86b8-4544-8657-c40c36208019 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:53.531956 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a4b2effb-86b8-4544-8657-c40c36208019 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1365 microversion: 2.1 time: 0.147321 Jun 15 15:56:53.532513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 344/699] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:53 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:54.211138 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-81edde4f-69b7-4f28-ae63-0091f39b8a0b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:54.211722 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-81edde4f-69b7-4f28-ae63-0091f39b8a0b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:54.218129 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-81edde4f-69b7-4f28-ae63-0091f39b8a0b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:54.218576 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-81edde4f-69b7-4f28-ae63-0091f39b8a0b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:54.219379 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-81edde4f-69b7-4f28-ae63-0091f39b8a0b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:54.219797 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-81edde4f-69b7-4f28-ae63-0091f39b8a0b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:54.248249 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-81edde4f-69b7-4f28-ae63-0091f39b8a0b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments/2e9c4bdd-279b-4796-958d-af5d9b32dc29" status: 200 len: 194 microversion: 2.20 time: 0.041149 Jun 15 15:56:54.248903 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 356/700] 10.222.0.62 () {60 vars in 1453 bytes} [Wed Jun 15 15:56:54 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments/2e9c4bdd-279b-4796-958d-af5d9b32dc29 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:56:54.311720 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0ee818c1-4c73-4ccd-a153-a44e5bcd53d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:54.312207 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0ee818c1-4c73-4ccd-a153-a44e5bcd53d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:54.318063 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0ee818c1-4c73-4ccd-a153-a44e5bcd53d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:54.318500 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0ee818c1-4c73-4ccd-a153-a44e5bcd53d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:54.319282 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0ee818c1-4c73-4ccd-a153-a44e5bcd53d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:54.319710 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0ee818c1-4c73-4ccd-a153-a44e5bcd53d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:54.400803 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-0ee818c1-4c73-4ccd-a153-a44e5bcd53d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lazy-loading 'services' on Instance uuid c8ff33fe-05bf-4bd5-9159-69805bae0aed {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:56:54.471099 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0ee818c1-4c73-4ccd-a153-a44e5bcd53d5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments/2e9c4bdd-279b-4796-958d-af5d9b32dc29" status: 202 len: 0 microversion: 2.20 time: 0.163656 Jun 15 15:56:54.471673 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 345/701] 10.222.0.62 () {60 vars in 1456 bytes} [Wed Jun 15 15:56:54 2022] DELETE /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments/2e9c4bdd-279b-4796-958d-af5d9b32dc29 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:56:54.480716 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4edcc9ba-41b8-44e1-9f59-23fba8deb1ac tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:54.481701 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4edcc9ba-41b8-44e1-9f59-23fba8deb1ac tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:54.487687 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4edcc9ba-41b8-44e1-9f59-23fba8deb1ac tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:54.488135 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4edcc9ba-41b8-44e1-9f59-23fba8deb1ac tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:54.488898 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4edcc9ba-41b8-44e1-9f59-23fba8deb1ac tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:54.489335 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4edcc9ba-41b8-44e1-9f59-23fba8deb1ac tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:54.519267 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4edcc9ba-41b8-44e1-9f59-23fba8deb1ac tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042919 Jun 15 15:56:54.519810 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 357/702] 10.222.0.62 () {60 vars in 1342 bytes} [Wed Jun 15 15:56:54 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:56:54.548976 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-75d7c341-80d2-4d2e-b9bc-0d350034e90c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:54.549633 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-75d7c341-80d2-4d2e-b9bc-0d350034e90c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:54.556972 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-75d7c341-80d2-4d2e-b9bc-0d350034e90c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:54.557425 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-75d7c341-80d2-4d2e-b9bc-0d350034e90c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:54.558195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-75d7c341-80d2-4d2e-b9bc-0d350034e90c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:54.558630 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-75d7c341-80d2-4d2e-b9bc-0d350034e90c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:54.694230 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-75d7c341-80d2-4d2e-b9bc-0d350034e90c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:54.701535 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-75d7c341-80d2-4d2e-b9bc-0d350034e90c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1365 microversion: 2.1 time: 0.156846 Jun 15 15:56:54.702122 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 346/703] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:54 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:55.533383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-fad73782-f2a4-4411-91c8-b33ffddb311f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:55.534329 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-fad73782-f2a4-4411-91c8-b33ffddb311f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:55.541694 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fad73782-f2a4-4411-91c8-b33ffddb311f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:55.542128 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fad73782-f2a4-4411-91c8-b33ffddb311f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:55.542915 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fad73782-f2a4-4411-91c8-b33ffddb311f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:55.543352 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fad73782-f2a4-4411-91c8-b33ffddb311f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:55.571637 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fad73782-f2a4-4411-91c8-b33ffddb311f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044034 Jun 15 15:56:55.572469 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 358/704] 10.222.0.62 () {60 vars in 1342 bytes} [Wed Jun 15 15:56:55 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:56:55.718068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-628e6e68-0a6f-4a02-a0f3-aa54c6402207 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:55.718600 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-628e6e68-0a6f-4a02-a0f3-aa54c6402207 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:55.725136 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-628e6e68-0a6f-4a02-a0f3-aa54c6402207 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:55.725583 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-628e6e68-0a6f-4a02-a0f3-aa54c6402207 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:55.726348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-628e6e68-0a6f-4a02-a0f3-aa54c6402207 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:55.726811 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-628e6e68-0a6f-4a02-a0f3-aa54c6402207 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:55.855200 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-628e6e68-0a6f-4a02-a0f3-aa54c6402207 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:55.862619 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-628e6e68-0a6f-4a02-a0f3-aa54c6402207 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1365 microversion: 2.1 time: 0.148583 Jun 15 15:56:55.863229 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 347/705] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:55 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:56.582738 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4153a003-0aae-45c8-b6a9-6e24835caa6d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:56.583675 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4153a003-0aae-45c8-b6a9-6e24835caa6d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:56.585586 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=6 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:56.592996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4153a003-0aae-45c8-b6a9-6e24835caa6d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:56.593439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4153a003-0aae-45c8-b6a9-6e24835caa6d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:56.594197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4153a003-0aae-45c8-b6a9-6e24835caa6d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:56.594627 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4153a003-0aae-45c8-b6a9-6e24835caa6d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:56.628600 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4153a003-0aae-45c8-b6a9-6e24835caa6d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049787 Jun 15 15:56:56.630159 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 359/706] 10.222.0.62 () {60 vars in 1342 bytes} [Wed Jun 15 15:56:56 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:56:56.686083 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6f71d41e-9155-40fd-a67c-c68c7db037ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:56.686571 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6f71d41e-9155-40fd-a67c-c68c7db037ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:56.688520 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:56.689268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=6 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:56.695171 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6f71d41e-9155-40fd-a67c-c68c7db037ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:56.695611 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6f71d41e-9155-40fd-a67c-c68c7db037ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:56.696384 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6f71d41e-9155-40fd-a67c-c68c7db037ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:56.696818 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6f71d41e-9155-40fd-a67c-c68c7db037ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:56.720386 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6f71d41e-9155-40fd-a67c-c68c7db037ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Going to try to terminate instance {{(pid=123935) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:56:56.800928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6f71d41e-9155-40fd-a67c-c68c7db037ce tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 204 len: 0 microversion: 2.20 time: 0.118277 Jun 15 15:56:56.801746 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 348/707] 10.222.0.62 () {60 vars in 1279 bytes} [Wed Jun 15 15:56:56 2022] DELETE /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 15:56:56.810443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-edf346c7-4dd5-4fc7-a8b5-81317779a4c9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:56.811090 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-edf346c7-4dd5-4fc7-a8b5-81317779a4c9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:56.817201 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-edf346c7-4dd5-4fc7-a8b5-81317779a4c9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:56.817650 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-edf346c7-4dd5-4fc7-a8b5-81317779a4c9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:56.818412 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-edf346c7-4dd5-4fc7-a8b5-81317779a4c9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:56.818872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-edf346c7-4dd5-4fc7-a8b5-81317779a4c9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:56.880007 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f3e1cf38-833a-4ddf-b9cf-1405af2e6bbf tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:56.880806 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f3e1cf38-833a-4ddf-b9cf-1405af2e6bbf tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:56.887030 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f3e1cf38-833a-4ddf-b9cf-1405af2e6bbf tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:56.887476 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f3e1cf38-833a-4ddf-b9cf-1405af2e6bbf tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:56.888241 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f3e1cf38-833a-4ddf-b9cf-1405af2e6bbf tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:56.888722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f3e1cf38-833a-4ddf-b9cf-1405af2e6bbf tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:56.990710 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-edf346c7-4dd5-4fc7-a8b5-81317779a4c9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:56.999207 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-edf346c7-4dd5-4fc7-a8b5-81317779a4c9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:57.000702 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-edf346c7-4dd5-4fc7-a8b5-81317779a4c9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:57.001877 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-edf346c7-4dd5-4fc7-a8b5-81317779a4c9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.195366 Jun 15 15:56:57.002434 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 360/708] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:56:56 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:56:57.035160 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f3e1cf38-833a-4ddf-b9cf-1405af2e6bbf tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:57.043457 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f3e1cf38-833a-4ddf-b9cf-1405af2e6bbf tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1365 microversion: 2.1 time: 0.167784 Jun 15 15:56:57.044022 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 349/709] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:56 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:56:57.755373 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-6a7c7c42-d9e8-4555-abef-3752beaf0553 req-56008b9e-159e-4022-903d-2fa0497fe0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfc8df9-5cac-41ce-8af4-47483c7b5d95", "name": "network-vif-plugged", "status": "completed", "tag": "874420e5-c070-43f3-99c3-c445ee22fedf"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:56:57.764760 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-6a7c7c42-d9e8-4555-abef-3752beaf0553 req-56008b9e-159e-4022-903d-2fa0497fe0e0 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:57.765321 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-6a7c7c42-d9e8-4555-abef-3752beaf0553 req-56008b9e-159e-4022-903d-2fa0497fe0e0 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:57.778543 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-6a7c7c42-d9e8-4555-abef-3752beaf0553 req-56008b9e-159e-4022-903d-2fa0497fe0e0 service nova] Creating event network-vif-plugged:874420e5-c070-43f3-99c3-c445ee22fedf for instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 on hv-cinder-84599 Jun 15 15:56:57.784044 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-6a7c7c42-d9e8-4555-abef-3752beaf0553 req-56008b9e-159e-4022-903d-2fa0497fe0e0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032290 Jun 15 15:56:57.784640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 361/710] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:56:58.019517 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-321f02fa-d121-4535-a8cb-2f84219bc453 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:58.020248 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-321f02fa-d121-4535-a8cb-2f84219bc453 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:58.026822 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-321f02fa-d121-4535-a8cb-2f84219bc453 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:58.027307 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-321f02fa-d121-4535-a8cb-2f84219bc453 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:58.028068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-321f02fa-d121-4535-a8cb-2f84219bc453 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:58.028501 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-321f02fa-d121-4535-a8cb-2f84219bc453 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:58.047764 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:56:58.062822 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8bb4caf6-0c7d-4d1a-af3f-be19fc359502 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:58.064286 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8bb4caf6-0c7d-4d1a-af3f-be19fc359502 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:58.070954 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8bb4caf6-0c7d-4d1a-af3f-be19fc359502 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:58.071403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8bb4caf6-0c7d-4d1a-af3f-be19fc359502 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:58.072278 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8bb4caf6-0c7d-4d1a-af3f-be19fc359502 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:58.072713 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8bb4caf6-0c7d-4d1a-af3f-be19fc359502 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:58.224035 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-321f02fa-d121-4535-a8cb-2f84219bc453 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:58.232867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-321f02fa-d121-4535-a8cb-2f84219bc453 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:58.234376 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-321f02fa-d121-4535-a8cb-2f84219bc453 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:58.235569 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-321f02fa-d121-4535-a8cb-2f84219bc453 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.220281 Jun 15 15:56:58.236320 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 350/711] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:56:58 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:56:58.255289 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8bb4caf6-0c7d-4d1a-af3f-be19fc359502 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:58.263855 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8bb4caf6-0c7d-4d1a-af3f-be19fc359502 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1365 microversion: 2.1 time: 0.206416 Jun 15 15:56:58.264837 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 362/712] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:58 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:56:59.255844 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-467dcf80-1c4f-4c4c-8c95-e8f1fe31d241 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:59.256446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-467dcf80-1c4f-4c4c-8c95-e8f1fe31d241 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:59.263581 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-467dcf80-1c4f-4c4c-8c95-e8f1fe31d241 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:59.264075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-467dcf80-1c4f-4c4c-8c95-e8f1fe31d241 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:59.264834 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-467dcf80-1c4f-4c4c-8c95-e8f1fe31d241 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:59.265262 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-467dcf80-1c4f-4c4c-8c95-e8f1fe31d241 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:59.281173 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b8ac6a6f-c51c-42c6-9067-a74bb322e9d1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:56:59.281779 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b8ac6a6f-c51c-42c6-9067-a74bb322e9d1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:56:59.288448 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b8ac6a6f-c51c-42c6-9067-a74bb322e9d1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:59.288892 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b8ac6a6f-c51c-42c6-9067-a74bb322e9d1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:59.289649 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b8ac6a6f-c51c-42c6-9067-a74bb322e9d1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:56:59.290084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b8ac6a6f-c51c-42c6-9067-a74bb322e9d1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:56:59.465655 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-467dcf80-1c4f-4c4c-8c95-e8f1fe31d241 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:59.472356 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b8ac6a6f-c51c-42c6-9067-a74bb322e9d1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:59.473595 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-467dcf80-1c4f-4c4c-8c95-e8f1fe31d241 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:59.475128 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-467dcf80-1c4f-4c4c-8c95-e8f1fe31d241 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:56:59.476272 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-467dcf80-1c4f-4c4c-8c95-e8f1fe31d241 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.224346 Jun 15 15:56:59.476820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 351/713] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:56:59 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:56:59.480629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b8ac6a6f-c51c-42c6-9067-a74bb322e9d1 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1365 microversion: 2.1 time: 0.203267 Jun 15 15:56:59.481201 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 363/714] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:56:59 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:57:00.495722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c514abdf-b28a-4d46-91e6-183373989e00 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:00.496313 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c514abdf-b28a-4d46-91e6-183373989e00 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:00.497497 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9eee8abe-902d-473c-bfa7-e7de5df4e999 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:00.498108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9eee8abe-902d-473c-bfa7-e7de5df4e999 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:00.502789 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c514abdf-b28a-4d46-91e6-183373989e00 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:00.503261 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c514abdf-b28a-4d46-91e6-183373989e00 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:00.504014 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c514abdf-b28a-4d46-91e6-183373989e00 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:00.504217 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9eee8abe-902d-473c-bfa7-e7de5df4e999 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:00.504438 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c514abdf-b28a-4d46-91e6-183373989e00 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:00.504661 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9eee8abe-902d-473c-bfa7-e7de5df4e999 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:00.505417 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9eee8abe-902d-473c-bfa7-e7de5df4e999 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:00.505846 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9eee8abe-902d-473c-bfa7-e7de5df4e999 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:00.698351 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c514abdf-b28a-4d46-91e6-183373989e00 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:00.701454 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-9eee8abe-902d-473c-bfa7-e7de5df4e999 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:00.706359 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c514abdf-b28a-4d46-91e6-183373989e00 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:00.707967 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c514abdf-b28a-4d46-91e6-183373989e00 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:00.708763 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9eee8abe-902d-473c-bfa7-e7de5df4e999 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1365 microversion: 2.1 time: 0.215082 Jun 15 15:57:00.709271 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c514abdf-b28a-4d46-91e6-183373989e00 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1722 microversion: 2.20 time: 0.217955 Jun 15 15:57:00.709430 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 364/715] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:00 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:57:00.709936 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 352/716] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:00 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:01.726591 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-999998af-7254-4d35-b0c8-64cd848249ed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:01.727776 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8a78cb15-a32a-447f-85e6-a5e5fd4ba608 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:01.728140 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-999998af-7254-4d35-b0c8-64cd848249ed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:01.728244 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-8a78cb15-a32a-447f-85e6-a5e5fd4ba608 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:01.734625 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8a78cb15-a32a-447f-85e6-a5e5fd4ba608 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:01.734943 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-999998af-7254-4d35-b0c8-64cd848249ed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:01.735234 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8a78cb15-a32a-447f-85e6-a5e5fd4ba608 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:01.735364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-999998af-7254-4d35-b0c8-64cd848249ed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:01.736002 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8a78cb15-a32a-447f-85e6-a5e5fd4ba608 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:01.736186 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-999998af-7254-4d35-b0c8-64cd848249ed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:01.736619 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8a78cb15-a32a-447f-85e6-a5e5fd4ba608 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:01.736738 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-999998af-7254-4d35-b0c8-64cd848249ed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:01.753534 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:01.832844 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8a78cb15-a32a-447f-85e6-a5e5fd4ba608 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:01.841831 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8a78cb15-a32a-447f-85e6-a5e5fd4ba608 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:01.843472 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8a78cb15-a32a-447f-85e6-a5e5fd4ba608 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:01.844688 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-8a78cb15-a32a-447f-85e6-a5e5fd4ba608 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1655 microversion: 2.20 time: 0.121809 Jun 15 15:57:01.845319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 353/717] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:01 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1655 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:57:01.859654 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-3634e713-b3e5-4abe-8d13-40eff3bcb98b req-9015d988-217f-4c38-a3fc-acd4ce90d34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ff33fe-05bf-4bd5-9159-69805bae0aed", "name": "network-vif-deleted", "tag": "229f5bd2-2de2-41f9-ac9f-ef6b3af254d6"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:01.868525 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-3634e713-b3e5-4abe-8d13-40eff3bcb98b req-9015d988-217f-4c38-a3fc-acd4ce90d34c service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:01.868961 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-3634e713-b3e5-4abe-8d13-40eff3bcb98b req-9015d988-217f-4c38-a3fc-acd4ce90d34c service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:01.881223 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-3634e713-b3e5-4abe-8d13-40eff3bcb98b req-9015d988-217f-4c38-a3fc-acd4ce90d34c service nova] Creating event network-vif-deleted:229f5bd2-2de2-41f9-ac9f-ef6b3af254d6 for instance c8ff33fe-05bf-4bd5-9159-69805bae0aed on hv-cinder-84599 Jun 15 15:57:01.886987 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-3634e713-b3e5-4abe-8d13-40eff3bcb98b req-9015d988-217f-4c38-a3fc-acd4ce90d34c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030804 Jun 15 15:57:01.888137 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 354/718] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:57:01.933048 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-999998af-7254-4d35-b0c8-64cd848249ed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:01.940636 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-999998af-7254-4d35-b0c8-64cd848249ed tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1554 microversion: 2.1 time: 0.218330 Jun 15 15:57:01.941327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 365/719] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:01 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:01.958098 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e2af8279-e151-472e-b847-c99f50e63ac6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:01.958675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e2af8279-e151-472e-b847-c99f50e63ac6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:01.965983 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e2af8279-e151-472e-b847-c99f50e63ac6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:01.966664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e2af8279-e151-472e-b847-c99f50e63ac6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:01.967463 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e2af8279-e151-472e-b847-c99f50e63ac6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:01.968059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e2af8279-e151-472e-b847-c99f50e63ac6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:02.051739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e2af8279-e151-472e-b847-c99f50e63ac6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097699 Jun 15 15:57:02.052330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 355/720] 10.222.0.62 () {58 vars in 1274 bytes} [Wed Jun 15 15:57:01 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:57:02.863393 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:02.864110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:02.871228 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:02.871771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:02.872626 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:02.873115 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:02.903918 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:02.904360 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:02.904799 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lazy-loading 'fault' on Instance uuid c8ff33fe-05bf-4bd5-9159-69805bae0aed {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:57:02.949022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:02.958437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:02.960507 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:02.961848 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a10820e3-97e0-4ac4-9249-850ce1e1c1fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 200 len: 1372 microversion: 2.20 time: 0.102301 Jun 15 15:57:02.962538 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 366/721] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:02 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:02.982389 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-f7c2d1cc-20db-4cf3-8836-d4f7531ae3a4 req-dec27e6d-5659-4b32-9f79-ddde8b28b713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfc8df9-5cac-41ce-8af4-47483c7b5d95", "tag": "874420e5-c070-43f3-99c3-c445ee22fedf"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:02.990568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-f7c2d1cc-20db-4cf3-8836-d4f7531ae3a4 req-dec27e6d-5659-4b32-9f79-ddde8b28b713 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:02.991047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-f7c2d1cc-20db-4cf3-8836-d4f7531ae3a4 req-dec27e6d-5659-4b32-9f79-ddde8b28b713 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:03.002631 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-f7c2d1cc-20db-4cf3-8836-d4f7531ae3a4 req-dec27e6d-5659-4b32-9f79-ddde8b28b713 service nova] Creating event network-changed:874420e5-c070-43f3-99c3-c445ee22fedf for instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 on hv-cinder-84599 Jun 15 15:57:03.007457 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-f7c2d1cc-20db-4cf3-8836-d4f7531ae3a4 req-dec27e6d-5659-4b32-9f79-ddde8b28b713 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029279 Jun 15 15:57:03.008857 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 356/722] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:57:03.980831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c152af1c-43a9-401a-853f-f6438f46f82b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:03.981473 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c152af1c-43a9-401a-853f-f6438f46f82b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:03.984009 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:03.989633 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c152af1c-43a9-401a-853f-f6438f46f82b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:03.990084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c152af1c-43a9-401a-853f-f6438f46f82b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:03.990885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c152af1c-43a9-401a-853f-f6438f46f82b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:03.991327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c152af1c-43a9-401a-853f-f6438f46f82b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:04.008800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-c152af1c-43a9-401a-853f-f6438f46f82b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] HTTP exception thrown: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c152af1c-43a9-401a-853f-f6438f46f82b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Request method failure captured: Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed HTTP/1.1 Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-r6N4foMJuutu2sNAc27dMG4j4sMfGSN5HXKLCQIRoYj5qzh184gfmaLJyYfMs2LRcMVLz9UlfaNi_MO3BWE643SM4qdChJh0CloXr9P6kUr5Owx3SWe6HA4HKN_tdtWZVtmt3V8pInD4SxOWURcg8J1K0vHP5oxMTMmw5qRr-0_A Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:57:04.010553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e7b007aaf80436f8fa691a12a95f21e", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 3af6df3efbb74db4958654503e17d82e Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 15:57:04.012220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': 'c8ff33fe-05bf-4bd5-9159-69805bae0aed'} Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:57:04.013160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 15:57:04.014937 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:57:04.016255 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c152af1c-43a9-401a-853f-f6438f46f82b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Returning 404 to user: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:57:04.016255 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c152af1c-43a9-401a-853f-f6438f46f82b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 404 len: 111 microversion: 2.20 time: 0.038839 Jun 15 15:57:04.016255 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 367/723] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:03 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 15:57:04.025132 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9749602d-6cdb-4fc6-a589-3db30cbc9cee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '.version_select at 0x7fd8d8287a60>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:04.049711 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9749602d-6cdb-4fc6-a589-3db30cbc9cee tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044509986" status: 204 len: 0 microversion: 2.20 time: 0.028515 Jun 15 15:57:04.053598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 357/724] 10.222.0.62 () {60 vars in 1261 bytes} [Wed Jun 15 15:57:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044509986 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 15 15:57:04.713183 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c37ed1c7-441b-49c0-966f-81a5a7373bd5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Action: 'create', calling method: .version_select at 0x7fd8dc1641f0>, body: {"keypair": {"name": "tempest-keypair-1463660353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIszubw1zP3Oxa5eBAiI22XUdIbyksbHBTSGL0PyARW29xyIr/z1a+AUy9GBdiunIHzP1nAVxSXqRmvuYzimYmGJcty+oQlCWtedsN5lj1CCm5EHv2k1XmsNU0cFtCU1zw=="}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:04.727535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-c37ed1c7-441b-49c0-966f-81a5a7373bd5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Getting quotas for project 9e7b007aaf80436f8fa691a12a95f21e. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:57:04.731291 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-c37ed1c7-441b-49c0-966f-81a5a7373bd5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Getting quotas for user 3af6df3efbb74db4958654503e17d82e and project 9e7b007aaf80436f8fa691a12a95f21e. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:57:04.753377 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c37ed1c7-441b-49c0-966f-81a5a7373bd5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044148 Jun 15 15:57:04.753973 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 368/725] 10.222.0.62 () {62 vars in 1199 bytes} [Wed Jun 15 15:57:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 15 15:57:06.010756 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1288851448", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a79121ae-82b6-4471-a1d9-5c9a99177a07"}], "security_groups": [{"name": "tempest-securitygroup--589754041"}], "key_name": "tempest-keypair-1463660353", "user_data": "}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:06.019718 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:06.113435 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] validate_networks() for [('a79121ae-82b6-4471-a1d9-5c9a99177a07', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:57:06.477955 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:57:06.478396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:57:06.478910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:57:06.479463 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:57:06.479871 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:57:06.488493 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:06.488933 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:06.489745 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:06.490173 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:06.507029 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Getting quotas for project 9e7b007aaf80436f8fa691a12a95f21e. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:57:06.510901 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Getting quotas for user 3af6df3efbb74db4958654503e17d82e and project 9e7b007aaf80436f8fa691a12a95f21e. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:57:06.521433 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:57:06.523750 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:57:06.569597 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-009ccd75-98c1-46f4-a58a-07bd64a3c06d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.564425 Jun 15 15:57:06.570231 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 358/726] 10.222.0.62 () {62 vars in 1187 bytes} [Wed Jun 15 15:57:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 15 15:57:06.580207 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6e0c3f77-5d83-46e4-96f9-f7e6d50dc37f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:06.580839 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6e0c3f77-5d83-46e4-96f9-f7e6d50dc37f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:06.632610 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6e0c3f77-5d83-46e4-96f9-f7e6d50dc37f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:06.640534 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6e0c3f77-5d83-46e4-96f9-f7e6d50dc37f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:06.642031 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6e0c3f77-5d83-46e4-96f9-f7e6d50dc37f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:06.643223 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6e0c3f77-5d83-46e4-96f9-f7e6d50dc37f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1282 microversion: 2.20 time: 0.067039 Jun 15 15:57:06.643760 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 369/727] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:06 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1282 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:07.662217 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3d2b6446-8f61-489b-8d7c-0af3d256462b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:07.662875 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3d2b6446-8f61-489b-8d7c-0af3d256462b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:07.670080 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3d2b6446-8f61-489b-8d7c-0af3d256462b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:07.670567 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3d2b6446-8f61-489b-8d7c-0af3d256462b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:07.671485 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3d2b6446-8f61-489b-8d7c-0af3d256462b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:07.671930 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3d2b6446-8f61-489b-8d7c-0af3d256462b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:07.738363 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3d2b6446-8f61-489b-8d7c-0af3d256462b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:07.748142 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3d2b6446-8f61-489b-8d7c-0af3d256462b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:07.749646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3d2b6446-8f61-489b-8d7c-0af3d256462b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:07.750769 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3d2b6446-8f61-489b-8d7c-0af3d256462b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1334 microversion: 2.20 time: 0.093295 Jun 15 15:57:07.751378 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 359/728] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:07 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:08.768889 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1589451d-892c-45f8-9b56-131a31ab06bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:08.769597 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1589451d-892c-45f8-9b56-131a31ab06bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:08.776719 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1589451d-892c-45f8-9b56-131a31ab06bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:08.777237 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1589451d-892c-45f8-9b56-131a31ab06bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:08.778789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1589451d-892c-45f8-9b56-131a31ab06bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:08.778789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1589451d-892c-45f8-9b56-131a31ab06bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:09.019491 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1589451d-892c-45f8-9b56-131a31ab06bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:09.027703 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1589451d-892c-45f8-9b56-131a31ab06bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:09.029200 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1589451d-892c-45f8-9b56-131a31ab06bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:09.030295 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1589451d-892c-45f8-9b56-131a31ab06bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1407 microversion: 2.20 time: 0.265361 Jun 15 15:57:09.031075 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 370/729] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:08 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:09.421840 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-c4553d0c-544e-467b-8271-00dc3276128d req-cecaf354-0be7-4dde-b4d9-f5b902e7638a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c4bb33d-2d9f-4620-9e94-f28e12cd604f", "tag": "6153ea23-abc5-46cb-96ff-6597e6888d85"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:09.436268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-c4553d0c-544e-467b-8271-00dc3276128d req-cecaf354-0be7-4dde-b4d9-f5b902e7638a service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:09.436848 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-c4553d0c-544e-467b-8271-00dc3276128d req-cecaf354-0be7-4dde-b4d9-f5b902e7638a service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:09.452723 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-c4553d0c-544e-467b-8271-00dc3276128d req-cecaf354-0be7-4dde-b4d9-f5b902e7638a service nova] Creating event network-changed:6153ea23-abc5-46cb-96ff-6597e6888d85 for instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f on hv-cinder-84599 Jun 15 15:57:09.457579 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-c4553d0c-544e-467b-8271-00dc3276128d req-cecaf354-0be7-4dde-b4d9-f5b902e7638a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039342 Jun 15 15:57:09.458779 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 360/730] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:57:10.050426 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0c3a80ce-c785-4c84-a1fd-6a35bb873f34 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:10.051021 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0c3a80ce-c785-4c84-a1fd-6a35bb873f34 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:10.057517 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c3a80ce-c785-4c84-a1fd-6a35bb873f34 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:10.057959 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c3a80ce-c785-4c84-a1fd-6a35bb873f34 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:10.058761 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c3a80ce-c785-4c84-a1fd-6a35bb873f34 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:10.059198 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c3a80ce-c785-4c84-a1fd-6a35bb873f34 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:10.187183 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0c3a80ce-c785-4c84-a1fd-6a35bb873f34 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:10.194992 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0c3a80ce-c785-4c84-a1fd-6a35bb873f34 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:10.196998 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0c3a80ce-c785-4c84-a1fd-6a35bb873f34 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:10.198067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0c3a80ce-c785-4c84-a1fd-6a35bb873f34 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1407 microversion: 2.20 time: 0.153071 Jun 15 15:57:10.198614 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 371/731] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:10 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:11.216785 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-137a4cdb-8f81-472c-82fc-0f850dc3fde8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:11.217510 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-137a4cdb-8f81-472c-82fc-0f850dc3fde8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:11.223686 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-137a4cdb-8f81-472c-82fc-0f850dc3fde8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:11.224132 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-137a4cdb-8f81-472c-82fc-0f850dc3fde8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:11.224887 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-137a4cdb-8f81-472c-82fc-0f850dc3fde8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:11.225317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-137a4cdb-8f81-472c-82fc-0f850dc3fde8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:11.357091 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-137a4cdb-8f81-472c-82fc-0f850dc3fde8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:11.364936 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-137a4cdb-8f81-472c-82fc-0f850dc3fde8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:11.366440 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-137a4cdb-8f81-472c-82fc-0f850dc3fde8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:11.367562 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-137a4cdb-8f81-472c-82fc-0f850dc3fde8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1407 microversion: 2.20 time: 0.155638 Jun 15 15:57:11.368116 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 361/732] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:11 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:12.385121 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f7e7813d-3c0b-4457-bae8-7a2becf6452c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:12.385700 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f7e7813d-3c0b-4457-bae8-7a2becf6452c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:12.392182 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f7e7813d-3c0b-4457-bae8-7a2becf6452c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:12.392670 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f7e7813d-3c0b-4457-bae8-7a2becf6452c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:12.393406 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f7e7813d-3c0b-4457-bae8-7a2becf6452c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:12.393828 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f7e7813d-3c0b-4457-bae8-7a2becf6452c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:12.519460 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f7e7813d-3c0b-4457-bae8-7a2becf6452c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:12.527311 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f7e7813d-3c0b-4457-bae8-7a2becf6452c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:12.528822 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f7e7813d-3c0b-4457-bae8-7a2becf6452c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:12.529909 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f7e7813d-3c0b-4457-bae8-7a2becf6452c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1407 microversion: 2.20 time: 0.148701 Jun 15 15:57:12.530459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 372/733] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:12 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:13.548437 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-738e2d6a-54e1-43ec-a1a5-dfd58d45c37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:13.549039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-738e2d6a-54e1-43ec-a1a5-dfd58d45c37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:13.555881 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-738e2d6a-54e1-43ec-a1a5-dfd58d45c37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:13.556322 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-738e2d6a-54e1-43ec-a1a5-dfd58d45c37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:13.557075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-738e2d6a-54e1-43ec-a1a5-dfd58d45c37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:13.557500 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-738e2d6a-54e1-43ec-a1a5-dfd58d45c37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:13.728456 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-738e2d6a-54e1-43ec-a1a5-dfd58d45c37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:13.736454 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-738e2d6a-54e1-43ec-a1a5-dfd58d45c37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:13.737940 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-738e2d6a-54e1-43ec-a1a5-dfd58d45c37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:13.739043 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-738e2d6a-54e1-43ec-a1a5-dfd58d45c37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1407 microversion: 2.20 time: 0.194518 Jun 15 15:57:13.739782 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 362/734] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:13 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:14.757051 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bc9a8bc5-54e0-4b0a-95e5-20964cd6bc71 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:14.757647 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bc9a8bc5-54e0-4b0a-95e5-20964cd6bc71 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:14.764187 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc9a8bc5-54e0-4b0a-95e5-20964cd6bc71 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:14.764633 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc9a8bc5-54e0-4b0a-95e5-20964cd6bc71 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:14.765388 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc9a8bc5-54e0-4b0a-95e5-20964cd6bc71 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:14.765821 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bc9a8bc5-54e0-4b0a-95e5-20964cd6bc71 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:14.893040 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc9a8bc5-54e0-4b0a-95e5-20964cd6bc71 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:14.901471 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc9a8bc5-54e0-4b0a-95e5-20964cd6bc71 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:14.902994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bc9a8bc5-54e0-4b0a-95e5-20964cd6bc71 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:14.904102 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bc9a8bc5-54e0-4b0a-95e5-20964cd6bc71 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1407 microversion: 2.20 time: 0.150961 Jun 15 15:57:14.904646 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 373/735] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:14 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:15.922846 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-39a36b97-5b03-4448-855f-9b30a88cf9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:15.923439 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-39a36b97-5b03-4448-855f-9b30a88cf9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:15.929876 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-39a36b97-5b03-4448-855f-9b30a88cf9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:15.930322 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-39a36b97-5b03-4448-855f-9b30a88cf9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:15.931620 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-39a36b97-5b03-4448-855f-9b30a88cf9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:15.932051 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-39a36b97-5b03-4448-855f-9b30a88cf9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:15.969268 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-6e8717b0-3e46-410d-9ebe-9f81de739f55 req-0e6c56d4-9e61-4439-866c-eaf226643d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c4bb33d-2d9f-4620-9e94-f28e12cd604f", "name": "network-vif-plugged", "status": "completed", "tag": "6153ea23-abc5-46cb-96ff-6597e6888d85"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:15.978495 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-6e8717b0-3e46-410d-9ebe-9f81de739f55 req-0e6c56d4-9e61-4439-866c-eaf226643d86 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:15.978976 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-6e8717b0-3e46-410d-9ebe-9f81de739f55 req-0e6c56d4-9e61-4439-866c-eaf226643d86 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:15.991643 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-6e8717b0-3e46-410d-9ebe-9f81de739f55 req-0e6c56d4-9e61-4439-866c-eaf226643d86 service nova] Creating event network-vif-plugged:6153ea23-abc5-46cb-96ff-6597e6888d85 for instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f on hv-cinder-84599 Jun 15 15:57:15.997610 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-6e8717b0-3e46-410d-9ebe-9f81de739f55 req-0e6c56d4-9e61-4439-866c-eaf226643d86 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031974 Jun 15 15:57:15.998510 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 374/736] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:57:16.069000 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-39a36b97-5b03-4448-855f-9b30a88cf9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:16.076980 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-39a36b97-5b03-4448-855f-9b30a88cf9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:16.078500 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-39a36b97-5b03-4448-855f-9b30a88cf9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:16.079632 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-39a36b97-5b03-4448-855f-9b30a88cf9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1407 microversion: 2.20 time: 0.160841 Jun 15 15:57:16.080189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 363/737] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:15 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:17.094457 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=6 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:17.099284 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3220de52-8a4b-4135-8f8d-f0621feb2943 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:17.099977 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3220de52-8a4b-4135-8f8d-f0621feb2943 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:17.107099 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3220de52-8a4b-4135-8f8d-f0621feb2943 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:17.107547 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3220de52-8a4b-4135-8f8d-f0621feb2943 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:17.108305 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3220de52-8a4b-4135-8f8d-f0621feb2943 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:17.108737 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3220de52-8a4b-4135-8f8d-f0621feb2943 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:17.236862 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3220de52-8a4b-4135-8f8d-f0621feb2943 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:17.244593 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3220de52-8a4b-4135-8f8d-f0621feb2943 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:17.246078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3220de52-8a4b-4135-8f8d-f0621feb2943 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:17.247236 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3220de52-8a4b-4135-8f8d-f0621feb2943 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1407 microversion: 2.20 time: 0.153769 Jun 15 15:57:17.247769 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 375/738] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:17 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:18.265015 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-77353ecb-91b0-4fb8-9dc7-6e11619d6793 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:18.265602 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-77353ecb-91b0-4fb8-9dc7-6e11619d6793 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:18.267579 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:18.268244 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=6 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:18.274893 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-77353ecb-91b0-4fb8-9dc7-6e11619d6793 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:18.275349 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-77353ecb-91b0-4fb8-9dc7-6e11619d6793 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:18.276113 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-77353ecb-91b0-4fb8-9dc7-6e11619d6793 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:18.276549 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-77353ecb-91b0-4fb8-9dc7-6e11619d6793 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:18.408166 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-77353ecb-91b0-4fb8-9dc7-6e11619d6793 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:18.416848 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-77353ecb-91b0-4fb8-9dc7-6e11619d6793 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:18.418348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-77353ecb-91b0-4fb8-9dc7-6e11619d6793 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:18.419509 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-77353ecb-91b0-4fb8-9dc7-6e11619d6793 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1599 microversion: 2.20 time: 0.158591 Jun 15 15:57:18.420069 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 364/739] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:57:18 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:57:18.437094 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-20bd5825-0778-4424-a7f9-fe9c42e3c2f8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:18.437589 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-20bd5825-0778-4424-a7f9-fe9c42e3c2f8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:18.444016 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20bd5825-0778-4424-a7f9-fe9c42e3c2f8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:18.444479 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20bd5825-0778-4424-a7f9-fe9c42e3c2f8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:18.445230 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20bd5825-0778-4424-a7f9-fe9c42e3c2f8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:18.445649 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-20bd5825-0778-4424-a7f9-fe9c42e3c2f8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:18.519397 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-20bd5825-0778-4424-a7f9-fe9c42e3c2f8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.086198 Jun 15 15:57:18.519980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 376/740] 10.222.0.62 () {60 vars in 1315 bytes} [Wed Jun 15 15:57:18 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/os-interface => generated 285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 15 15:57:19.409502 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-6326a195-a117-4b96-96c2-e00c1c91956f req-a7ecbda4-1252-40d5-8535-25e5a91c72d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c4bb33d-2d9f-4620-9e94-f28e12cd604f", "tag": "6153ea23-abc5-46cb-96ff-6597e6888d85"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:19.418874 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-6326a195-a117-4b96-96c2-e00c1c91956f req-a7ecbda4-1252-40d5-8535-25e5a91c72d2 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:19.419318 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-6326a195-a117-4b96-96c2-e00c1c91956f req-a7ecbda4-1252-40d5-8535-25e5a91c72d2 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:19.432299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-6326a195-a117-4b96-96c2-e00c1c91956f req-a7ecbda4-1252-40d5-8535-25e5a91c72d2 service nova] Creating event network-changed:6153ea23-abc5-46cb-96ff-6597e6888d85 for instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f on hv-cinder-84599 Jun 15 15:57:19.437467 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-6326a195-a117-4b96-96c2-e00c1c91956f req-a7ecbda4-1252-40d5-8535-25e5a91c72d2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031619 Jun 15 15:57:19.438210 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 365/741] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:57:40.458510 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:40.459298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=50 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:40.464325 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-02a1be03-8eb5-4f11-9321-3145aa8e88cc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:40.465234 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-02a1be03-8eb5-4f11-9321-3145aa8e88cc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:40.472462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-02a1be03-8eb5-4f11-9321-3145aa8e88cc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:40.472910 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-02a1be03-8eb5-4f11-9321-3145aa8e88cc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:40.473669 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-02a1be03-8eb5-4f11-9321-3145aa8e88cc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:40.474104 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-02a1be03-8eb5-4f11-9321-3145aa8e88cc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:40.502465 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-02a1be03-8eb5-4f11-9321-3145aa8e88cc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045520 Jun 15 15:57:40.503042 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 377/742] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:57:40 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:57:40.557233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:40.558522 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=64 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:40.563759 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-49df4b82-bf41-4c3b-99ae-d7889770d20d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:40.564380 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-49df4b82-bf41-4c3b-99ae-d7889770d20d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:40.572016 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-49df4b82-bf41-4c3b-99ae-d7889770d20d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:40.572533 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-49df4b82-bf41-4c3b-99ae-d7889770d20d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:40.573294 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-49df4b82-bf41-4c3b-99ae-d7889770d20d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:40.573719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-49df4b82-bf41-4c3b-99ae-d7889770d20d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:40.598824 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-49df4b82-bf41-4c3b-99ae-d7889770d20d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Going to try to terminate instance {{(pid=123935) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:57:40.674701 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-49df4b82-bf41-4c3b-99ae-d7889770d20d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 204 len: 0 microversion: 2.1 time: 0.118928 Jun 15 15:57:40.675226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 366/743] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:57:40 2022] DELETE /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:57:40.683320 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7cb8a37d-6963-488d-891a-f1acb510be09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:40.683917 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7cb8a37d-6963-488d-891a-f1acb510be09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:40.689832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7cb8a37d-6963-488d-891a-f1acb510be09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:40.690268 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7cb8a37d-6963-488d-891a-f1acb510be09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:40.691035 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7cb8a37d-6963-488d-891a-f1acb510be09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:40.691460 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7cb8a37d-6963-488d-891a-f1acb510be09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:40.816579 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7cb8a37d-6963-488d-891a-f1acb510be09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:40.824431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7cb8a37d-6963-488d-891a-f1acb510be09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1673 microversion: 2.1 time: 0.144929 Jun 15 15:57:40.824983 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 378/744] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:40 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1673 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:57:41.842642 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b18fb6e7-4c07-4831-bfe2-21cd7b87c92e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:41.843272 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b18fb6e7-4c07-4831-bfe2-21cd7b87c92e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:41.849616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b18fb6e7-4c07-4831-bfe2-21cd7b87c92e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:41.850055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b18fb6e7-4c07-4831-bfe2-21cd7b87c92e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:41.850829 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b18fb6e7-4c07-4831-bfe2-21cd7b87c92e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:41.851252 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b18fb6e7-4c07-4831-bfe2-21cd7b87c92e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:41.981685 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b18fb6e7-4c07-4831-bfe2-21cd7b87c92e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:41.989207 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b18fb6e7-4c07-4831-bfe2-21cd7b87c92e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1673 microversion: 2.1 time: 0.150823 Jun 15 15:57:41.989776 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 367/745] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:41 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:43.005256 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4f6bae76-10cb-4efb-8fc4-b5de2e821a07 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:43.005864 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4f6bae76-10cb-4efb-8fc4-b5de2e821a07 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:43.011997 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4f6bae76-10cb-4efb-8fc4-b5de2e821a07 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:43.012439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4f6bae76-10cb-4efb-8fc4-b5de2e821a07 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:43.013242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4f6bae76-10cb-4efb-8fc4-b5de2e821a07 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:43.013675 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4f6bae76-10cb-4efb-8fc4-b5de2e821a07 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:43.459514 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4f6bae76-10cb-4efb-8fc4-b5de2e821a07 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:43.468489 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4f6bae76-10cb-4efb-8fc4-b5de2e821a07 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 200 len: 1673 microversion: 2.1 time: 0.466914 Jun 15 15:57:43.469070 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 379/746] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:43 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 1673 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:43.748646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-d8273c12-3a01-4f96-96d0-e93ec2b83e74 req-20e14758-cd4c-4a89-bceb-c4db4dab3c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e67259e-9dd3-4875-9185-fa11291a54d9", "name": "network-vif-deleted", "tag": "a85add08-672c-4dce-8f28-ed6c32fa8484"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:43.759185 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-d8273c12-3a01-4f96-96d0-e93ec2b83e74 req-20e14758-cd4c-4a89-bceb-c4db4dab3c52 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:43.759632 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-d8273c12-3a01-4f96-96d0-e93ec2b83e74 req-20e14758-cd4c-4a89-bceb-c4db4dab3c52 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:43.771308 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-d8273c12-3a01-4f96-96d0-e93ec2b83e74 req-20e14758-cd4c-4a89-bceb-c4db4dab3c52 service nova] Creating event network-vif-deleted:a85add08-672c-4dce-8f28-ed6c32fa8484 for instance 9e67259e-9dd3-4875-9185-fa11291a54d9 on hv-cinder-84599 Jun 15 15:57:43.776462 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-d8273c12-3a01-4f96-96d0-e93ec2b83e74 req-20e14758-cd4c-4a89-bceb-c4db4dab3c52 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032559 Jun 15 15:57:43.777418 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 368/747] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:57:44.485470 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a8c38719-aa19-4a25-ac38-d736063a4bde tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:44.486084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a8c38719-aa19-4a25-ac38-d736063a4bde tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:44.493193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a8c38719-aa19-4a25-ac38-d736063a4bde tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:44.493932 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a8c38719-aa19-4a25-ac38-d736063a4bde tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:44.494781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a8c38719-aa19-4a25-ac38-d736063a4bde tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:44.495538 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a8c38719-aa19-4a25-ac38-d736063a4bde tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:44.510657 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-a8c38719-aa19-4a25-ac38-d736063a4bde tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] HTTP exception thrown: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a8c38719-aa19-4a25-ac38-d736063a4bde tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Request method failure captured: Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 HTTP/1.1 Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-mlqOr39MFRHDxJwpOEApB2zneCqHrPlwXdC9EHztaF_cJxqGM4gPtnOm7pHDBJ6mXBqh9I07hcjPauXPUE4JdLH5gOZ9TZOqsoQMy_Dq1i1tADcxNwh92cdeS30mMSoGJwilokLVnaS3S5ECOPldXwX3-e6bOVbHs6pyblAmP700 Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:57:44.512358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_669dc76c39b3427b8c55fd47de62595f", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeTestJSON-1833433233 Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 434c81b82dee404f8d143f1bdf56d3ca Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 15:57:44.513919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '9e67259e-9dd3-4875-9185-fa11291a54d9'} Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:57:44.514785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 15:57:44.516060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:57:44.517197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a8c38719-aa19-4a25-ac38-d736063a4bde tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Returning 404 to user: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:57:44.517197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a8c38719-aa19-4a25-ac38-d736063a4bde tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 404 len: 111 microversion: 2.1 time: 0.032259 Jun 15 15:57:44.517197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 380/748] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:44 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:57:44.524369 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e328e11f-f0be-4813-a0b0-d99341cc0737 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '.version_select at 0x7fd8d845d790>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:44.543204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e328e11f-f0be-4813-a0b0-d99341cc0737 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230254056" status: 202 len: 0 microversion: 2.1 time: 0.024076 Jun 15 15:57:44.543779 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 369/749] 10.222.0.62 () {58 vars in 1220 bytes} [Wed Jun 15 15:57:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230254056 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:57:45.178883 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6f2cb2d2-0bce-4a29-af47-027185d68edb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Action: 'create', calling method: .version_select at 0x7fd8d8294160>, body: {"keypair": {"name": "tempest-keypair-2096012584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9g4BLVbl6VyhROlzTkrv3bvB+iKBx7hshL9FiKFU2AQezwFDSdQMBQCJ2Q0nVAb6PdGk+4RgdybyptCWmi49LlrQRKUBXEPwKQ4ks4qPmQGMOksBft9V0iaPkArbHYCg=="}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:45.192535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-6f2cb2d2-0bce-4a29-af47-027185d68edb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Getting quotas for project 669dc76c39b3427b8c55fd47de62595f. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:57:45.196288 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-6f2cb2d2-0bce-4a29-af47-027185d68edb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Getting quotas for user 434c81b82dee404f8d143f1bdf56d3ca and project 669dc76c39b3427b8c55fd47de62595f. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:57:45.219907 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6f2cb2d2-0bce-4a29-af47-027185d68edb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044901 Jun 15 15:57:45.220481 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 381/750] 10.222.0.62 () {60 vars in 1158 bytes} [Wed Jun 15 15:57:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:57:46.413083 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-165905540", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddf1b2b0-3215-4fd9-b0bf-7ad7c9d71640"}], "security_groups": [{"name": "tempest-securitygroup--1655737025"}], "key_name": "tempest-keypair-2096012584", "user_data": "}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:46.516610 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] validate_networks() for [('ddf1b2b0-3215-4fd9-b0bf-7ad7c9d71640', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:57:46.870299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:57:46.870783 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:57:46.871262 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:57:46.871673 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:57:46.872141 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:57:46.880749 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:46.881178 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:46.881974 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:46.882411 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:46.899278 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Getting quotas for project 669dc76c39b3427b8c55fd47de62595f. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:57:46.903889 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Getting quotas for user 434c81b82dee404f8d143f1bdf56d3ca and project 669dc76c39b3427b8c55fd47de62595f. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:57:46.914935 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:57:46.917253 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:57:46.963374 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2cf8d909-193a-4ad5-a796-a4ff5140940f tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.554836 Jun 15 15:57:46.964027 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 370/751] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:57:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:57:46.974548 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5a7d74b5-806c-4cce-b53c-08423e612a29 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:46.975275 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5a7d74b5-806c-4cce-b53c-08423e612a29 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:47.028274 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5a7d74b5-806c-4cce-b53c-08423e612a29 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:47.035154 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5a7d74b5-806c-4cce-b53c-08423e612a29 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1237 microversion: 2.1 time: 0.064686 Jun 15 15:57:47.035711 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 382/752] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:46 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:48.052214 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fe36e0ba-9212-4e17-ba7a-e218f9d2285e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:48.052974 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fe36e0ba-9212-4e17-ba7a-e218f9d2285e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:48.059962 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fe36e0ba-9212-4e17-ba7a-e218f9d2285e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:48.060408 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fe36e0ba-9212-4e17-ba7a-e218f9d2285e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:48.061509 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fe36e0ba-9212-4e17-ba7a-e218f9d2285e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:48.061945 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fe36e0ba-9212-4e17-ba7a-e218f9d2285e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:48.138026 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fe36e0ba-9212-4e17-ba7a-e218f9d2285e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:48.147196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fe36e0ba-9212-4e17-ba7a-e218f9d2285e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1297 microversion: 2.1 time: 0.099432 Jun 15 15:57:48.147789 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 371/753] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:48 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:49.165626 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2dab3188-6cb0-4e02-9044-9265c4afd9ee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:49.166872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2dab3188-6cb0-4e02-9044-9265c4afd9ee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:49.173159 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2dab3188-6cb0-4e02-9044-9265c4afd9ee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:49.173598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2dab3188-6cb0-4e02-9044-9265c4afd9ee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:49.174345 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2dab3188-6cb0-4e02-9044-9265c4afd9ee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:49.174792 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2dab3188-6cb0-4e02-9044-9265c4afd9ee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:49.407186 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2dab3188-6cb0-4e02-9044-9265c4afd9ee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:49.415212 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2dab3188-6cb0-4e02-9044-9265c4afd9ee tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1363 microversion: 2.1 time: 0.253780 Jun 15 15:57:49.416551 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 383/754] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:49 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:49.585607 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-97738d9f-41aa-4838-a039-dfd6a53d749b req-4030644c-0d3a-4c29-a829-962ca01d54fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e47f87-a115-44d0-93d9-3181aa6f631e", "tag": "8570634e-e484-40f9-b3b3-3edbfe2fe2bc"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:49.597129 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-97738d9f-41aa-4838-a039-dfd6a53d749b req-4030644c-0d3a-4c29-a829-962ca01d54fa service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:49.597612 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-97738d9f-41aa-4838-a039-dfd6a53d749b req-4030644c-0d3a-4c29-a829-962ca01d54fa service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:49.611894 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-97738d9f-41aa-4838-a039-dfd6a53d749b req-4030644c-0d3a-4c29-a829-962ca01d54fa service nova] Creating event network-changed:8570634e-e484-40f9-b3b3-3edbfe2fe2bc for instance e3e47f87-a115-44d0-93d9-3181aa6f631e on hv-cinder-84599 Jun 15 15:57:49.616730 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-97738d9f-41aa-4838-a039-dfd6a53d749b req-4030644c-0d3a-4c29-a829-962ca01d54fa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035248 Jun 15 15:57:49.617331 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 372/755] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:57:50.433120 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c70f7c9d-8ed9-4272-8fd2-ff3dc421d51e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:50.433717 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c70f7c9d-8ed9-4272-8fd2-ff3dc421d51e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:50.440345 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c70f7c9d-8ed9-4272-8fd2-ff3dc421d51e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:50.440813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c70f7c9d-8ed9-4272-8fd2-ff3dc421d51e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:50.441598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c70f7c9d-8ed9-4272-8fd2-ff3dc421d51e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:50.442080 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c70f7c9d-8ed9-4272-8fd2-ff3dc421d51e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:50.572472 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c70f7c9d-8ed9-4272-8fd2-ff3dc421d51e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:50.579859 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c70f7c9d-8ed9-4272-8fd2-ff3dc421d51e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1363 microversion: 2.1 time: 0.151140 Jun 15 15:57:50.580418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 384/756] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:50 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:51.597245 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-84530de2-175a-4548-87ba-4fbc1ac60994 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:51.597943 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-84530de2-175a-4548-87ba-4fbc1ac60994 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:51.604673 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-84530de2-175a-4548-87ba-4fbc1ac60994 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:51.605123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-84530de2-175a-4548-87ba-4fbc1ac60994 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:51.605877 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-84530de2-175a-4548-87ba-4fbc1ac60994 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:51.606315 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-84530de2-175a-4548-87ba-4fbc1ac60994 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:51.733055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-84530de2-175a-4548-87ba-4fbc1ac60994 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:51.740443 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-84530de2-175a-4548-87ba-4fbc1ac60994 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1363 microversion: 2.1 time: 0.147445 Jun 15 15:57:51.741014 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 373/757] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:51 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:52.757832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-72bef6e3-d309-4f5a-9d82-c08c9ff7123a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:52.758394 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-72bef6e3-d309-4f5a-9d82-c08c9ff7123a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:52.765392 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-72bef6e3-d309-4f5a-9d82-c08c9ff7123a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:52.765842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-72bef6e3-d309-4f5a-9d82-c08c9ff7123a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:52.766598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-72bef6e3-d309-4f5a-9d82-c08c9ff7123a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:52.767059 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-72bef6e3-d309-4f5a-9d82-c08c9ff7123a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:52.896361 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-72bef6e3-d309-4f5a-9d82-c08c9ff7123a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:52.904334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-72bef6e3-d309-4f5a-9d82-c08c9ff7123a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1363 microversion: 2.1 time: 0.150425 Jun 15 15:57:52.904885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 385/758] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:52 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:53.921342 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-20708a10-7dc7-4fbd-9e0e-c5615a5ab4b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:53.921990 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-20708a10-7dc7-4fbd-9e0e-c5615a5ab4b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:53.928494 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-20708a10-7dc7-4fbd-9e0e-c5615a5ab4b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:53.928941 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-20708a10-7dc7-4fbd-9e0e-c5615a5ab4b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:53.929702 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-20708a10-7dc7-4fbd-9e0e-c5615a5ab4b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:53.930171 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-20708a10-7dc7-4fbd-9e0e-c5615a5ab4b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:54.301766 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-20708a10-7dc7-4fbd-9e0e-c5615a5ab4b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:54.309878 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-20708a10-7dc7-4fbd-9e0e-c5615a5ab4b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1363 microversion: 2.1 time: 0.392395 Jun 15 15:57:54.310444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 374/759] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:53 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1363 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:55.328093 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b7f75cd8-514c-4def-9148-34421bcf570d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:55.328720 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b7f75cd8-514c-4def-9148-34421bcf570d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:55.335199 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b7f75cd8-514c-4def-9148-34421bcf570d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:55.335641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b7f75cd8-514c-4def-9148-34421bcf570d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:55.336421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b7f75cd8-514c-4def-9148-34421bcf570d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:55.336865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b7f75cd8-514c-4def-9148-34421bcf570d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:55.460671 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b7f75cd8-514c-4def-9148-34421bcf570d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:55.467999 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b7f75cd8-514c-4def-9148-34421bcf570d tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1363 microversion: 2.1 time: 0.143783 Jun 15 15:57:55.468540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 386/760] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:55 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:56.284291 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-72ee6a42-f08b-4a8a-8e31-215e7c11e95f req-4816b928-e73e-4753-9985-0058ac4532fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e47f87-a115-44d0-93d9-3181aa6f631e", "name": "network-vif-plugged", "status": "completed", "tag": "8570634e-e484-40f9-b3b3-3edbfe2fe2bc"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:57:56.293755 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-72ee6a42-f08b-4a8a-8e31-215e7c11e95f req-4816b928-e73e-4753-9985-0058ac4532fb service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:56.294181 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-72ee6a42-f08b-4a8a-8e31-215e7c11e95f req-4816b928-e73e-4753-9985-0058ac4532fb service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:56.305579 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-72ee6a42-f08b-4a8a-8e31-215e7c11e95f req-4816b928-e73e-4753-9985-0058ac4532fb service nova] Creating event network-vif-plugged:8570634e-e484-40f9-b3b3-3edbfe2fe2bc for instance e3e47f87-a115-44d0-93d9-3181aa6f631e on hv-cinder-84599 Jun 15 15:57:56.314706 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-72ee6a42-f08b-4a8a-8e31-215e7c11e95f req-4816b928-e73e-4753-9985-0058ac4532fb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033523 Jun 15 15:57:56.316552 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 375/761] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:57:56.484794 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0a99f6fd-882a-4cf7-8ffe-43d8246efe06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:56.485449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0a99f6fd-882a-4cf7-8ffe-43d8246efe06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:56.492195 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0a99f6fd-882a-4cf7-8ffe-43d8246efe06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:56.492641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0a99f6fd-882a-4cf7-8ffe-43d8246efe06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:56.493405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0a99f6fd-882a-4cf7-8ffe-43d8246efe06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:56.493840 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0a99f6fd-882a-4cf7-8ffe-43d8246efe06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:56.677604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0a99f6fd-882a-4cf7-8ffe-43d8246efe06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:56.685753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0a99f6fd-882a-4cf7-8ffe-43d8246efe06 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1363 microversion: 2.1 time: 0.204712 Jun 15 15:57:56.686256 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 387/762] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:56 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:57.702248 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:57.703409 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=6 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:57.709505 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d8afb2db-c8f3-4061-8219-52c4b0c70bf5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:57.710235 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d8afb2db-c8f3-4061-8219-52c4b0c70bf5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:57.717263 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8afb2db-c8f3-4061-8219-52c4b0c70bf5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:57.717715 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8afb2db-c8f3-4061-8219-52c4b0c70bf5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:57.718478 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8afb2db-c8f3-4061-8219-52c4b0c70bf5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:57.718955 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d8afb2db-c8f3-4061-8219-52c4b0c70bf5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:57.860195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d8afb2db-c8f3-4061-8219-52c4b0c70bf5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:57.868660 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d8afb2db-c8f3-4061-8219-52c4b0c70bf5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1363 microversion: 2.1 time: 0.167887 Jun 15 15:57:57.869228 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 376/763] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:57 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:58.886492 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-44f110c5-a8ba-43b6-9f7c-1ca561256210 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:58.887123 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-44f110c5-a8ba-43b6-9f7c-1ca561256210 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:58.888984 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=6 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:57:58.895016 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-44f110c5-a8ba-43b6-9f7c-1ca561256210 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:58.895464 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-44f110c5-a8ba-43b6-9f7c-1ca561256210 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:58.896216 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-44f110c5-a8ba-43b6-9f7c-1ca561256210 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:58.896648 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-44f110c5-a8ba-43b6-9f7c-1ca561256210 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:59.021148 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-44f110c5-a8ba-43b6-9f7c-1ca561256210 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:57:59.028514 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-44f110c5-a8ba-43b6-9f7c-1ca561256210 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1363 microversion: 2.1 time: 0.146370 Jun 15 15:57:59.029069 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 388/764] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:57:58 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:57:59.631547 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e58367da-0cc2-449c-850a-fd24098da341 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:59.632060 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e58367da-0cc2-449c-850a-fd24098da341 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:59.639094 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e58367da-0cc2-449c-850a-fd24098da341 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:59.639536 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e58367da-0cc2-449c-850a-fd24098da341 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:59.640282 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e58367da-0cc2-449c-850a-fd24098da341 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:59.640709 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e58367da-0cc2-449c-850a-fd24098da341 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:59.719108 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-e58367da-0cc2-449c-850a-fd24098da341 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lazy-loading 'services' on Instance uuid 76bb4599-da4d-40fb-8de1-12edf17a8384 {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:57:59.789118 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e58367da-0cc2-449c-850a-fd24098da341 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "DELETE /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments/c99c8b13-3325-46d5-bf69-d34e23fdf4b7" status: 202 len: 0 microversion: 2.1 time: 0.161309 Jun 15 15:57:59.792840 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 377/765] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 15:57:59 2022] DELETE /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments/c99c8b13-3325-46d5-bf69-d34e23fdf4b7 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:57:59.798194 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0164979c-1789-40d2-b99a-1338419e3658 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:57:59.799277 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0164979c-1789-40d2-b99a-1338419e3658 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:57:59.805561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0164979c-1789-40d2-b99a-1338419e3658 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:59.806161 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0164979c-1789-40d2-b99a-1338419e3658 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:59.807019 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0164979c-1789-40d2-b99a-1338419e3658 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:57:59.808046 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0164979c-1789-40d2-b99a-1338419e3658 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:57:59.838121 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0164979c-1789-40d2-b99a-1338419e3658 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043968 Jun 15 15:57:59.838867 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 389/766] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:57:59 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:58:00.046801 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9e58ba67-9cdb-4b2a-86a3-5904ff126c4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:00.047527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9e58ba67-9cdb-4b2a-86a3-5904ff126c4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:00.053711 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9e58ba67-9cdb-4b2a-86a3-5904ff126c4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:00.054167 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9e58ba67-9cdb-4b2a-86a3-5904ff126c4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:00.054957 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9e58ba67-9cdb-4b2a-86a3-5904ff126c4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:00.055394 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9e58ba67-9cdb-4b2a-86a3-5904ff126c4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:00.185468 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9e58ba67-9cdb-4b2a-86a3-5904ff126c4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:00.192893 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9e58ba67-9cdb-4b2a-86a3-5904ff126c4e tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1550 microversion: 2.1 time: 0.150913 Jun 15 15:58:00.193459 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 378/767] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:00 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:00.209707 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-12dd24b0-23f3-4821-be4e-809cc770a254 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:00.210188 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-12dd24b0-23f3-4821-be4e-809cc770a254 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:00.216670 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-12dd24b0-23f3-4821-be4e-809cc770a254 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:00.217128 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-12dd24b0-23f3-4821-be4e-809cc770a254 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:00.217865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-12dd24b0-23f3-4821-be4e-809cc770a254 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:00.218285 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-12dd24b0-23f3-4821-be4e-809cc770a254 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:00.292276 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-12dd24b0-23f3-4821-be4e-809cc770a254 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086321 Jun 15 15:58:00.292861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 390/768] 10.222.0.62 () {58 vars in 1274 bytes} [Wed Jun 15 15:58:00 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:58:00.851512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-66802792-ad20-4433-8983-38117ea007ac tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:00.852547 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-66802792-ad20-4433-8983-38117ea007ac tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:00.859455 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-66802792-ad20-4433-8983-38117ea007ac tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:00.859900 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-66802792-ad20-4433-8983-38117ea007ac tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:00.860650 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-66802792-ad20-4433-8983-38117ea007ac tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:00.861079 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-66802792-ad20-4433-8983-38117ea007ac tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:00.890097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-66802792-ad20-4433-8983-38117ea007ac tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 Jun 15 15:58:00.890664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 379/769] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:58:00 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:58:01.205747 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-f094d9e3-666c-4068-aeca-5ad9ea6d0fbe req-a3a1ae39-2eaa-464f-ba38-e03b7085e81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e47f87-a115-44d0-93d9-3181aa6f631e", "tag": "8570634e-e484-40f9-b3b3-3edbfe2fe2bc"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:58:01.213738 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-f094d9e3-666c-4068-aeca-5ad9ea6d0fbe req-a3a1ae39-2eaa-464f-ba38-e03b7085e81b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:01.214352 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-f094d9e3-666c-4068-aeca-5ad9ea6d0fbe req-a3a1ae39-2eaa-464f-ba38-e03b7085e81b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:01.225233 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-f094d9e3-666c-4068-aeca-5ad9ea6d0fbe req-a3a1ae39-2eaa-464f-ba38-e03b7085e81b service nova] Creating event network-changed:8570634e-e484-40f9-b3b3-3edbfe2fe2bc for instance e3e47f87-a115-44d0-93d9-3181aa6f631e on hv-cinder-84599 Jun 15 15:58:01.231010 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-f094d9e3-666c-4068-aeca-5ad9ea6d0fbe req-a3a1ae39-2eaa-464f-ba38-e03b7085e81b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029269 Jun 15 15:58:01.231590 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 391/770] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:58:01.901626 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-dbd32db9-5586-495e-9a60-39a2dfecab4e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:01.902585 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-dbd32db9-5586-495e-9a60-39a2dfecab4e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:01.909132 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbd32db9-5586-495e-9a60-39a2dfecab4e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:01.909851 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbd32db9-5586-495e-9a60-39a2dfecab4e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:01.910643 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbd32db9-5586-495e-9a60-39a2dfecab4e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:01.911115 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbd32db9-5586-495e-9a60-39a2dfecab4e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:01.940760 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-dbd32db9-5586-495e-9a60-39a2dfecab4e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043036 Jun 15 15:58:01.941323 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 380/771] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:58:01 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 15:58:02.009569 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-466a728d-5ed1-4771-8c47-324de49e2ffd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:02.010146 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-466a728d-5ed1-4771-8c47-324de49e2ffd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:02.016477 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-466a728d-5ed1-4771-8c47-324de49e2ffd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:02.016927 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-466a728d-5ed1-4771-8c47-324de49e2ffd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:02.017693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-466a728d-5ed1-4771-8c47-324de49e2ffd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:02.018124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-466a728d-5ed1-4771-8c47-324de49e2ffd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:02.044565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-466a728d-5ed1-4771-8c47-324de49e2ffd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Going to try to terminate instance {{(pid=123934) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:58:02.125078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-466a728d-5ed1-4771-8c47-324de49e2ffd tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "DELETE /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 204 len: 0 microversion: 2.1 time: 0.119262 Jun 15 15:58:02.125695 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 392/772] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:58:02 2022] DELETE /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:58:02.133726 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1a36786f-a1f8-4d55-bd0a-4be85323b1ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:02.134276 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1a36786f-a1f8-4d55-bd0a-4be85323b1ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:02.141152 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1a36786f-a1f8-4d55-bd0a-4be85323b1ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:02.141872 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1a36786f-a1f8-4d55-bd0a-4be85323b1ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:02.142930 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1a36786f-a1f8-4d55-bd0a-4be85323b1ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:02.143617 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1a36786f-a1f8-4d55-bd0a-4be85323b1ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:02.283426 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1a36786f-a1f8-4d55-bd0a-4be85323b1ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:02.291697 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1a36786f-a1f8-4d55-bd0a-4be85323b1ee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1689 microversion: 2.1 time: 0.161765 Jun 15 15:58:02.292801 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 381/773] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:02 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:03.310443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-287a7d8d-7cd4-48b9-b3d2-42b15a6d2f87 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:03.311175 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-287a7d8d-7cd4-48b9-b3d2-42b15a6d2f87 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:03.319015 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-287a7d8d-7cd4-48b9-b3d2-42b15a6d2f87 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:03.319455 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-287a7d8d-7cd4-48b9-b3d2-42b15a6d2f87 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:03.320200 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-287a7d8d-7cd4-48b9-b3d2-42b15a6d2f87 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:03.320622 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-287a7d8d-7cd4-48b9-b3d2-42b15a6d2f87 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:03.454123 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-287a7d8d-7cd4-48b9-b3d2-42b15a6d2f87 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:03.461827 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-287a7d8d-7cd4-48b9-b3d2-42b15a6d2f87 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1689 microversion: 2.1 time: 0.156267 Jun 15 15:58:03.462421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 393/774] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:03 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:04.479002 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-89bcfe29-875b-4de4-b851-2fcccced97d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:04.480185 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-89bcfe29-875b-4de4-b851-2fcccced97d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:04.486406 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-89bcfe29-875b-4de4-b851-2fcccced97d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:04.486878 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-89bcfe29-875b-4de4-b851-2fcccced97d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:04.487636 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-89bcfe29-875b-4de4-b851-2fcccced97d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:04.488102 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-89bcfe29-875b-4de4-b851-2fcccced97d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:04.614649 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-89bcfe29-875b-4de4-b851-2fcccced97d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:04.623012 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-89bcfe29-875b-4de4-b851-2fcccced97d7 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1689 microversion: 2.1 time: 0.148063 Jun 15 15:58:04.623578 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 382/775] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:04 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:05.640198 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ba2f9a00-bd78-4c41-bcae-0eb2f3f79334 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:05.640798 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ba2f9a00-bd78-4c41-bcae-0eb2f3f79334 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:05.647252 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ba2f9a00-bd78-4c41-bcae-0eb2f3f79334 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:05.647690 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ba2f9a00-bd78-4c41-bcae-0eb2f3f79334 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:05.648445 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ba2f9a00-bd78-4c41-bcae-0eb2f3f79334 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:05.648873 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ba2f9a00-bd78-4c41-bcae-0eb2f3f79334 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:05.779578 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ba2f9a00-bd78-4c41-bcae-0eb2f3f79334 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:05.787212 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ba2f9a00-bd78-4c41-bcae-0eb2f3f79334 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1689 microversion: 2.1 time: 0.150918 Jun 15 15:58:05.787771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 394/776] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:05 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:06.803957 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9862a0d6-8667-438f-8bc2-ab16e77a9fba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:06.804499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9862a0d6-8667-438f-8bc2-ab16e77a9fba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:06.811274 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9862a0d6-8667-438f-8bc2-ab16e77a9fba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:06.811722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9862a0d6-8667-438f-8bc2-ab16e77a9fba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:06.812490 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9862a0d6-8667-438f-8bc2-ab16e77a9fba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:06.813027 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9862a0d6-8667-438f-8bc2-ab16e77a9fba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:07.019626 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9862a0d6-8667-438f-8bc2-ab16e77a9fba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:07.023208 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:58:07.028664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9862a0d6-8667-438f-8bc2-ab16e77a9fba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1689 microversion: 2.1 time: 0.228660 Jun 15 15:58:07.029281 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 383/777] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:06 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:07.686837 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-564edc47-c0e8-4c7c-9abd-98578c2a851b req-5712484f-6df8-4dd8-b789-2f4870805aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76bb4599-da4d-40fb-8de1-12edf17a8384", "name": "network-vif-deleted", "tag": "a4dbc8ca-933e-46fd-9b4c-8dc00d37465e"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:58:07.696698 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-564edc47-c0e8-4c7c-9abd-98578c2a851b req-5712484f-6df8-4dd8-b789-2f4870805aa5 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:07.697069 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-564edc47-c0e8-4c7c-9abd-98578c2a851b req-5712484f-6df8-4dd8-b789-2f4870805aa5 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:07.711380 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-564edc47-c0e8-4c7c-9abd-98578c2a851b req-5712484f-6df8-4dd8-b789-2f4870805aa5 service nova] Creating event network-vif-deleted:a4dbc8ca-933e-46fd-9b4c-8dc00d37465e for instance 76bb4599-da4d-40fb-8de1-12edf17a8384 on hv-cinder-84599 Jun 15 15:58:07.717003 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-564edc47-c0e8-4c7c-9abd-98578c2a851b req-5712484f-6df8-4dd8-b789-2f4870805aa5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033826 Jun 15 15:58:07.718923 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 395/778] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:58:08.047094 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-32e88a66-50fa-4469-89d5-e02584cb6eee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:08.047731 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-32e88a66-50fa-4469-89d5-e02584cb6eee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:08.055380 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32e88a66-50fa-4469-89d5-e02584cb6eee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:08.055834 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32e88a66-50fa-4469-89d5-e02584cb6eee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:08.056602 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32e88a66-50fa-4469-89d5-e02584cb6eee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:08.057041 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32e88a66-50fa-4469-89d5-e02584cb6eee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:08.088209 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32e88a66-50fa-4469-89d5-e02584cb6eee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:08.088666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32e88a66-50fa-4469-89d5-e02584cb6eee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:08.089628 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-32e88a66-50fa-4469-89d5-e02584cb6eee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lazy-loading 'fault' on Instance uuid 76bb4599-da4d-40fb-8de1-12edf17a8384 {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:58:08.129703 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-32e88a66-50fa-4469-89d5-e02584cb6eee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:08.139456 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-32e88a66-50fa-4469-89d5-e02584cb6eee tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 200 len: 1335 microversion: 2.1 time: 0.097870 Jun 15 15:58:08.140140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 384/779] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:08 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 1335 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:09.156974 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-47218637-a9d5-4caa-b989-9f038530a775 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:09.157686 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-47218637-a9d5-4caa-b989-9f038530a775 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 76bb4599-da4d-40fb-8de1-12edf17a8384] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:09.164623 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47218637-a9d5-4caa-b989-9f038530a775 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:09.165062 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47218637-a9d5-4caa-b989-9f038530a775 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:09.165804 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47218637-a9d5-4caa-b989-9f038530a775 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:09.166228 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-47218637-a9d5-4caa-b989-9f038530a775 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:09.171455 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:58:09.183839 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-47218637-a9d5-4caa-b989-9f038530a775 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] HTTP exception thrown: Instance 76bb4599-da4d-40fb-8de1-12edf17a8384 could not be found. Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-47218637-a9d5-4caa-b989-9f038530a775 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Request method failure captured: Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 HTTP/1.1 Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgAJQGYAJRl8YAWSmPSJEUL1Wp7YSAiHsrjh_EXMN13v3eyGOsp6BU_oMpiZd_kBcb2W-N_OFZbXfOcG-E9Fe7UGbRxs58tZ0yj78Bxro6IajNJkFyo7U9X9tDlMEha8AfDpzXzhRvv4bGqRBMii-zprZbYrs-1yOxD_a7hzl3rsPAs Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: f2ed62f01ef846569c069e52fcfee36a Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:58:09.185592 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f2ed62f01ef846569c069e52fcfee36a", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: f2ed62f01ef846569c069e52fcfee36a Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-ServerRescueNegativeTestJSON-579752165-project Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: f8fcb09990db433e8ac0af3de37bdbc7 Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-ServerRescueNegativeTestJSON-579752165-project Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 76bb4599-da4d-40fb-8de1-12edf17a8384 could not be found. Jun 15 15:58:09.186986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '76bb4599-da4d-40fb-8de1-12edf17a8384'} Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76bb4599-da4d-40fb-8de1-12edf17a8384 could not be found. Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:58:09.187842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76bb4599-da4d-40fb-8de1-12edf17a8384 could not be found. Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76bb4599-da4d-40fb-8de1-12edf17a8384 could not be found. Jun 15 15:58:09.189573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:09.192024 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-47218637-a9d5-4caa-b989-9f038530a775 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Returning 404 to user: Instance 76bb4599-da4d-40fb-8de1-12edf17a8384 could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:58:09.192024 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-47218637-a9d5-4caa-b989-9f038530a775 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384" status: 404 len: 111 microversion: 2.1 time: 0.034045 Jun 15 15:58:09.192024 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 396/780] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:09 2022] GET /compute/v2.1/servers/76bb4599-da4d-40fb-8de1-12edf17a8384 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:58:09.196272 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ac1067b0-d5a4-4556-a4ac-91b0d85d4305 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '.version_select at 0x7fd8d37eeee0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:09.212255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ac1067b0-d5a4-4556-a4ac-91b0d85d4305 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057632781" status: 202 len: 0 microversion: 2.1 time: 0.020423 Jun 15 15:58:09.212808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 385/781] 10.222.0.62 () {58 vars in 1220 bytes} [Wed Jun 15 15:58:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057632781 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:58:12.058660 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a30ec5b3-c9d1-4922-b9cb-35d3d9f2fd23 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:12.059175 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a30ec5b3-c9d1-4922-b9cb-35d3d9f2fd23 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:12.062008 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:58:12.069018 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a30ec5b3-c9d1-4922-b9cb-35d3d9f2fd23 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:12.069466 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a30ec5b3-c9d1-4922-b9cb-35d3d9f2fd23 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:12.070225 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a30ec5b3-c9d1-4922-b9cb-35d3d9f2fd23 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:12.070661 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a30ec5b3-c9d1-4922-b9cb-35d3d9f2fd23 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:12.102917 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a30ec5b3-c9d1-4922-b9cb-35d3d9f2fd23 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Going to try to terminate instance {{(pid=123934) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:58:12.176044 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a30ec5b3-c9d1-4922-b9cb-35d3d9f2fd23 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 204 len: 0 microversion: 2.1 time: 0.121165 Jun 15 15:58:12.176646 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 397/782] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:58:12 2022] DELETE /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:58:12.185828 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-761c6ff4-0185-4ab3-be80-92c3f2139cda tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:12.186527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-761c6ff4-0185-4ab3-be80-92c3f2139cda tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:12.188452 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:58:12.193855 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-761c6ff4-0185-4ab3-be80-92c3f2139cda tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:12.194307 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-761c6ff4-0185-4ab3-be80-92c3f2139cda tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:12.195106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-761c6ff4-0185-4ab3-be80-92c3f2139cda tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:12.195543 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-761c6ff4-0185-4ab3-be80-92c3f2139cda tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:12.325248 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-761c6ff4-0185-4ab3-be80-92c3f2139cda tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:12.332714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-761c6ff4-0185-4ab3-be80-92c3f2139cda tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1509 microversion: 2.1 time: 0.151876 Jun 15 15:58:12.333270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 386/783] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:12 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:13.350220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-518475d4-bd11-466c-a7ad-3bd64d9869c6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:13.350972 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-518475d4-bd11-466c-a7ad-3bd64d9869c6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:13.357358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-518475d4-bd11-466c-a7ad-3bd64d9869c6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:13.357805 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-518475d4-bd11-466c-a7ad-3bd64d9869c6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:13.358562 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-518475d4-bd11-466c-a7ad-3bd64d9869c6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:13.359026 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-518475d4-bd11-466c-a7ad-3bd64d9869c6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:13.545945 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-518475d4-bd11-466c-a7ad-3bd64d9869c6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:13.553331 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-518475d4-bd11-466c-a7ad-3bd64d9869c6 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 200 len: 1509 microversion: 2.1 time: 0.207390 Jun 15 15:58:13.553894 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 398/784] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:13 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:13.682485 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-00f3beb3-68cd-4ea1-9e30-d0486c07f588 req-10e00148-a050-41b7-b066-c64704f91f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3072d511-e603-4222-9e8e-69370d441b30", "name": "network-vif-deleted", "tag": "cb323fdc-7e88-452a-bf55-5b8f63d4e576"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:58:13.692626 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-00f3beb3-68cd-4ea1-9e30-d0486c07f588 req-10e00148-a050-41b7-b066-c64704f91f37 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:13.693125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-00f3beb3-68cd-4ea1-9e30-d0486c07f588 req-10e00148-a050-41b7-b066-c64704f91f37 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:13.705426 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-00f3beb3-68cd-4ea1-9e30-d0486c07f588 req-10e00148-a050-41b7-b066-c64704f91f37 service nova] Creating event network-vif-deleted:cb323fdc-7e88-452a-bf55-5b8f63d4e576 for instance 3072d511-e603-4222-9e8e-69370d441b30 on hv-cinder-84599 Jun 15 15:58:13.714939 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-00f3beb3-68cd-4ea1-9e30-d0486c07f588 req-10e00148-a050-41b7-b066-c64704f91f37 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035145 Jun 15 15:58:13.716159 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 387/785] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:58:14.570765 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-57cd141d-b846-418e-b73e-bfd4092f52ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:14.571327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-57cd141d-b846-418e-b73e-bfd4092f52ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: 3072d511-e603-4222-9e8e-69370d441b30] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:14.578392 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57cd141d-b846-418e-b73e-bfd4092f52ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:14.578865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57cd141d-b846-418e-b73e-bfd4092f52ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:14.579644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57cd141d-b846-418e-b73e-bfd4092f52ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:14.580072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57cd141d-b846-418e-b73e-bfd4092f52ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:14.593742 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-57cd141d-b846-418e-b73e-bfd4092f52ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] HTTP exception thrown: Instance 3072d511-e603-4222-9e8e-69370d441b30 could not be found. Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-57cd141d-b846-418e-b73e-bfd4092f52ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Request method failure captured: Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 HTTP/1.1 Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgAJQGYAJRl8YAWSmPSJEUL1Wp7YSAiHsrjh_EXMN13v3eyGOsp6BU_oMpiZd_kBcb2W-N_OFZbXfOcG-E9Fe7UGbRxs58tZ0yj78Bxro6IajNJkFyo7U9X9tDlMEha8AfDpzXzhRvv4bGqRBMii-zprZbYrs-1yOxD_a7hzl3rsPAs Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: f2ed62f01ef846569c069e52fcfee36a Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:58:14.595376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f2ed62f01ef846569c069e52fcfee36a", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: f2ed62f01ef846569c069e52fcfee36a Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-ServerRescueNegativeTestJSON-579752165-project Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: f8fcb09990db433e8ac0af3de37bdbc7 Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-ServerRescueNegativeTestJSON-579752165-project Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 3072d511-e603-4222-9e8e-69370d441b30 could not be found. Jun 15 15:58:14.596905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '3072d511-e603-4222-9e8e-69370d441b30'} Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3072d511-e603-4222-9e8e-69370d441b30 could not be found. Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:58:14.597847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3072d511-e603-4222-9e8e-69370d441b30 could not be found. Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3072d511-e603-4222-9e8e-69370d441b30 could not be found. Jun 15 15:58:14.599312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:14.600531 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-57cd141d-b846-418e-b73e-bfd4092f52ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Returning 404 to user: Instance 3072d511-e603-4222-9e8e-69370d441b30 could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:58:14.600531 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-57cd141d-b846-418e-b73e-bfd4092f52ae tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30" status: 404 len: 111 microversion: 2.1 time: 0.029912 Jun 15 15:58:14.600531 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 399/786] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:14 2022] GET /compute/v2.1/servers/3072d511-e603-4222-9e8e-69370d441b30 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:58:14.605816 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-634b0483-cedf-4fad-b15d-b182aa00f3dc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:14.606435 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-634b0483-cedf-4fad-b15d-b182aa00f3dc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:14.612745 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-634b0483-cedf-4fad-b15d-b182aa00f3dc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:14.613193 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-634b0483-cedf-4fad-b15d-b182aa00f3dc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:14.613947 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-634b0483-cedf-4fad-b15d-b182aa00f3dc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:14.614378 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-634b0483-cedf-4fad-b15d-b182aa00f3dc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:14.638958 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-634b0483-cedf-4fad-b15d-b182aa00f3dc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Going to try to terminate instance {{(pid=123935) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:58:14.712061 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-634b0483-cedf-4fad-b15d-b182aa00f3dc tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 204 len: 0 microversion: 2.1 time: 0.110080 Jun 15 15:58:14.712922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 388/787] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:58:14 2022] DELETE /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:58:14.720962 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-18dc09f1-fc02-4796-9fb1-026c2768caba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:14.721569 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-18dc09f1-fc02-4796-9fb1-026c2768caba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:14.727667 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-18dc09f1-fc02-4796-9fb1-026c2768caba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:14.728115 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-18dc09f1-fc02-4796-9fb1-026c2768caba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:14.728874 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-18dc09f1-fc02-4796-9fb1-026c2768caba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:14.729307 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-18dc09f1-fc02-4796-9fb1-026c2768caba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:15.089769 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-18dc09f1-fc02-4796-9fb1-026c2768caba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:15.097571 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-18dc09f1-fc02-4796-9fb1-026c2768caba tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.380447 Jun 15 15:58:15.098131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 400/788] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:14 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:16.114989 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e89f59cd-e17c-4c0f-8744-f13e2ce6f8cf tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:16.115682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e89f59cd-e17c-4c0f-8744-f13e2ce6f8cf tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:16.122061 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e89f59cd-e17c-4c0f-8744-f13e2ce6f8cf tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:16.122496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e89f59cd-e17c-4c0f-8744-f13e2ce6f8cf tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:16.123283 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e89f59cd-e17c-4c0f-8744-f13e2ce6f8cf tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:16.123717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e89f59cd-e17c-4c0f-8744-f13e2ce6f8cf tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:16.254900 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e89f59cd-e17c-4c0f-8744-f13e2ce6f8cf tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:16.263016 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e89f59cd-e17c-4c0f-8744-f13e2ce6f8cf tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.151578 Jun 15 15:58:16.263654 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 389/789] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:16 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:17.281037 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ad492d07-b819-4533-9adf-7bd95997f82e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:17.281919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ad492d07-b819-4533-9adf-7bd95997f82e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:17.289166 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ad492d07-b819-4533-9adf-7bd95997f82e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:17.289613 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ad492d07-b819-4533-9adf-7bd95997f82e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:17.290383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ad492d07-b819-4533-9adf-7bd95997f82e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:17.290841 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ad492d07-b819-4533-9adf-7bd95997f82e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:17.422630 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ad492d07-b819-4533-9adf-7bd95997f82e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:17.430079 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ad492d07-b819-4533-9adf-7bd95997f82e tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1522 microversion: 2.1 time: 0.153668 Jun 15 15:58:17.430634 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 401/790] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:17 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:17.867983 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 15:58:17.868228 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 15:58:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 15:58:18.446429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ed377260-1620-4568-96e4-279d2f25eead tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:18.447582 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ed377260-1620-4568-96e4-279d2f25eead tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:18.455064 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ed377260-1620-4568-96e4-279d2f25eead tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:18.455628 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ed377260-1620-4568-96e4-279d2f25eead tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:18.456792 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ed377260-1620-4568-96e4-279d2f25eead tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:18.457324 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ed377260-1620-4568-96e4-279d2f25eead tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:18.548262 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ed377260-1620-4568-96e4-279d2f25eead tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8fcb09990db433e8ac0af3de37bdbc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2ed62f01ef846569c069e52fcfee36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:18.556714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ed377260-1620-4568-96e4-279d2f25eead tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 200 len: 1480 microversion: 2.1 time: 0.114222 Jun 15 15:58:18.558265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 390/791] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:18 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 1480 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:18.563841 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-64e9f3cb-7429-47a4-95f2-2da0c988cf92 req-c8bc96dd-74cc-47f5-8dc9-1cb5a3f41062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c08c200b-6119-4bc7-955c-448d9956f01e", "name": "network-vif-deleted", "tag": "7022cf0a-9603-4a0a-856b-1193a989d68f"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:58:18.574361 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-64e9f3cb-7429-47a4-95f2-2da0c988cf92 req-c8bc96dd-74cc-47f5-8dc9-1cb5a3f41062 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:18.575484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-64e9f3cb-7429-47a4-95f2-2da0c988cf92 req-c8bc96dd-74cc-47f5-8dc9-1cb5a3f41062 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:18.589260 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-64e9f3cb-7429-47a4-95f2-2da0c988cf92 req-c8bc96dd-74cc-47f5-8dc9-1cb5a3f41062 service nova] Creating event network-vif-deleted:7022cf0a-9603-4a0a-856b-1193a989d68f for instance c08c200b-6119-4bc7-955c-448d9956f01e on hv-cinder-84599 Jun 15 15:58:18.594936 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-64e9f3cb-7429-47a4-95f2-2da0c988cf92 req-c8bc96dd-74cc-47f5-8dc9-1cb5a3f41062 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035309 Jun 15 15:58:18.596030 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 402/792] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:58:19.573781 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e3602ddf-8d36-4557-87b8-f5eec5d6f209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:19.574381 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e3602ddf-8d36-4557-87b8-f5eec5d6f209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] [instance: c08c200b-6119-4bc7-955c-448d9956f01e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:19.581354 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e3602ddf-8d36-4557-87b8-f5eec5d6f209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:19.581798 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e3602ddf-8d36-4557-87b8-f5eec5d6f209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:19.582548 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e3602ddf-8d36-4557-87b8-f5eec5d6f209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:19.583018 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e3602ddf-8d36-4557-87b8-f5eec5d6f209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:19.596824 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-e3602ddf-8d36-4557-87b8-f5eec5d6f209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] HTTP exception thrown: Instance c08c200b-6119-4bc7-955c-448d9956f01e could not be found. Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e3602ddf-8d36-4557-87b8-f5eec5d6f209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Request method failure captured: Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e HTTP/1.1 Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgAJQGYAJRl8YAWSmPSJEUL1Wp7YSAiHsrjh_EXMN13v3eyGOsp6BU_oMpiZd_kBcb2W-N_OFZbXfOcG-E9Fe7UGbRxs58tZ0yj78Bxro6IajNJkFyo7U9X9tDlMEha8AfDpzXzhRvv4bGqRBMii-zprZbYrs-1yOxD_a7hzl3rsPAs Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: f2ed62f01ef846569c069e52fcfee36a Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:58:19.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f2ed62f01ef846569c069e52fcfee36a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f2ed62f01ef846569c069e52fcfee36a", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: f2ed62f01ef846569c069e52fcfee36a Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-579752165 Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-ServerRescueNegativeTestJSON-579752165-project Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: f8fcb09990db433e8ac0af3de37bdbc7 Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-ServerRescueNegativeTestJSON-579752165-project Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance c08c200b-6119-4bc7-955c-448d9956f01e could not be found. Jun 15 15:58:19.599985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'c08c200b-6119-4bc7-955c-448d9956f01e'} Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c08c200b-6119-4bc7-955c-448d9956f01e could not be found. Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:58:19.600813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c08c200b-6119-4bc7-955c-448d9956f01e could not be found. Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c08c200b-6119-4bc7-955c-448d9956f01e could not be found. Jun 15 15:58:19.602232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:19.603606 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e3602ddf-8d36-4557-87b8-f5eec5d6f209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] Returning 404 to user: Instance c08c200b-6119-4bc7-955c-448d9956f01e could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:58:19.603606 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e3602ddf-8d36-4557-87b8-f5eec5d6f209 tempest-ServerRescueNegativeTestJSON-579752165 tempest-ServerRescueNegativeTestJSON-579752165-project] 10.222.0.62 "GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e" status: 404 len: 111 microversion: 2.1 time: 0.029936 Jun 15 15:58:19.603606 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 391/793] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:19 2022] GET /compute/v2.1/servers/c08c200b-6119-4bc7-955c-448d9956f01e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:58:23.981955 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-48e960a3-10de-467a-b2da-199254e5fc83 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Action: 'create', calling method: .version_select at 0x7fd8dc178d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-940041775", "metadata": {"Type": "work"}}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-48e960a3-10de-467a-b2da-199254e5fc83 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Request method failure captured: Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 121 Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgGfffld9wfyv1a2RtBCG4oTg4cAZ5y2BEKnqwaQcN9WnHMcCRgjtA42x90ry8kLuh5eao4xKx7LGQprVOZIlkzjPGEnj5-UwoErwl4A4CJiJUm3geJ370LcCbJEfYL-3cg3i6feI-oLwwfwxWTxzYt1ro3NceP6fwU-oM48sbGasA0 Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:58:24.006641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/117dafee744049e38fa222d261381e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_117dafee744049e38fa222d261381e71", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 5fb568fb6097445ea9c04eb33bbd48fd Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-940041775", "metadata": {"Type": "work"}}} Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: Jun 15 15:58:24.008072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-940041775', 'metadata': {'Type': 'work'}}}} Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise error Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi '#$%' Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:58:24.009383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 15:58:24.010980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 15:58:24.013467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 15 15:58:24.013467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.013467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-48e960a3-10de-467a-b2da-199254e5fc83 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:58:24.013467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-48e960a3-10de-467a-b2da-199254e5fc83 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141629 Jun 15 15:58:24.013467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 403/794] 10.222.0.62 () {60 vars in 1155 bytes} [Wed Jun 15 15:58:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:58:24.020976 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-261b9c67-3f9c-4ba1-96a6-421680461c0b tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Action: 'create', calling method: .version_select at 0x7fd8d8055700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1803201958", "metadata": {"Type": "work"}}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-261b9c67-3f9c-4ba1-96a6-421680461c0b tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Request method failure captured: Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 120 Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgGfffld9wfyv1a2RtBCG4oTg4cAZ5y2BEKnqwaQcN9WnHMcCRgjtA42x90ry8kLuh5eao4xKx7LGQprVOZIlkzjPGEnj5-UwoErwl4A4CJiJUm3geJ370LcCbJEfYL-3cg3i6feI-oLwwfwxWTxzYt1ro3NceP6fwU-oM48sbGasA0 Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:58:24.024233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/117dafee744049e38fa222d261381e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_117dafee744049e38fa222d261381e71", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 5fb568fb6097445ea9c04eb33bbd48fd Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1803201958", "metadata": {"Type": "work"}}} Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: Jun 15 15:58:24.025739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1803201958', 'metadata': {'Type': 'work'}}}} Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise error Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi '0' Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:58:24.026664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 15:58:24.028391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 15:58:24.029714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 15 15:58:24.029714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.029714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-261b9c67-3f9c-4ba1-96a6-421680461c0b tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:58:24.029714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-261b9c67-3f9c-4ba1-96a6-421680461c0b tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008830 Jun 15 15:58:24.029714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 392/795] 10.222.0.62 () {60 vars in 1155 bytes} [Wed Jun 15 15:58:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 15 15:58:24.035154 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e9e43b62-0e2b-43bd-8df1-a1062b4ed0d3 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Action: 'create', calling method: .version_select at 0x7fd8dc14e790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-139395592", "metadata": {"Type": "work"}}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e9e43b62-0e2b-43bd-8df1-a1062b4ed0d3 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Request method failure captured: Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 118 Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgGfffld9wfyv1a2RtBCG4oTg4cAZ5y2BEKnqwaQcN9WnHMcCRgjtA42x90ry8kLuh5eao4xKx7LGQprVOZIlkzjPGEnj5-UwoErwl4A4CJiJUm3geJ370LcCbJEfYL-3cg3i6feI-oLwwfwxWTxzYt1ro3NceP6fwU-oM48sbGasA0 Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:58:24.037449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/117dafee744049e38fa222d261381e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_117dafee744049e38fa222d261381e71", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 5fb568fb6097445ea9c04eb33bbd48fd Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-139395592", "metadata": {"Type": "work"}}} Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: Jun 15 15:58:24.038979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-139395592', 'metadata': {'Type': 'work'}}}} Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise error Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi '' Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:58:24.039880 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 15 15:58:24.041131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 15 15:58:24.042242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 15 15:58:24.042242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.042242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e9e43b62-0e2b-43bd-8df1-a1062b4ed0d3 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:58:24.042242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e9e43b62-0e2b-43bd-8df1-a1062b4ed0d3 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007725 Jun 15 15:58:24.042242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 404/796] 10.222.0.62 () {60 vars in 1155 bytes} [Wed Jun 15 15:58:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 15:58:24.047970 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-39ac112a-db1b-4b68-8cbc-4d11e594cb0e tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Calling method '.version_select at 0x7fd8d37e4940>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:24.077076 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-39ac112a-db1b-4b68-8cbc-4d11e594cb0e tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] HTTP exception thrown: Volume tempest-invalid-92305118 could not be found. Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-39ac112a-db1b-4b68-8cbc-4d11e594cb0e tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Request method failure captured: Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-92305118 HTTP/1.1 Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgGfffld9wfyv1a2RtBCG4oTg4cAZ5y2BEKnqwaQcN9WnHMcCRgjtA42x90ry8kLuh5eao4xKx7LGQprVOZIlkzjPGEnj5-UwoErwl4A4CJiJUm3geJ370LcCbJEfYL-3cg3i6feI-oLwwfwxWTxzYt1ro3NceP6fwU-oM48sbGasA0 Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:58:24.079165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/117dafee744049e38fa222d261381e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_117dafee744049e38fa222d261381e71", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 5fb568fb6097445ea9c04eb33bbd48fd Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Volume tempest-invalid-92305118 could not be found. Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'tempest-invalid-92305118'} Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:58:24.080659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-92305118 could not be found. (HTTP 404) (Request-ID: req-1c9eea0d-ec42-4309-91cf-4901a6f0ba9b) Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.081841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 15:58:24.083047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-92305118 could not be found. Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:58:24.084255 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-92305118 could not be found. Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-92305118 could not be found. Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-39ac112a-db1b-4b68-8cbc-4d11e594cb0e tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Returning 404 to user: Volume tempest-invalid-92305118 could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-39ac112a-db1b-4b68-8cbc-4d11e594cb0e tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-92305118" status: 404 len: 97 microversion: 2.1 time: 0.038093 Jun 15 15:58:24.085446 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 393/797] 10.222.0.62 () {58 vars in 1211 bytes} [Wed Jun 15 15:58:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-92305118 => generated 97 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 15 15:58:24.093861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4f5a497a-9497-455e-afce-f1ce5858c0dd tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004677 Jun 15 15:58:24.094781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 405/798] 10.222.0.62 () {58 vars in 1139 bytes} [Wed Jun 15 15:58:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 15 15:58:24.103110 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e94a2fcf-19fd-46f4-ba1e-ef445a5fed23 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003568 Jun 15 15:58:24.103602 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 394/799] 10.222.0.62 () {58 vars in 1136 bytes} [Wed Jun 15 15:58:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 15 15:58:24.112916 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-90f4d5a2-6312-4d79-9f27-869b87f832ef tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Calling method '.version_select at 0x7fd8dc14e820>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:24.140540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-90f4d5a2-6312-4d79-9f27-869b87f832ef tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] HTTP exception thrown: Volume 86df4199-4e1e-42e3-a652-a0b7081b70a5 could not be found. Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-90f4d5a2-6312-4d79-9f27-869b87f832ef tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Request method failure captured: Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: DELETE /compute/v2.1/os-volumes/86df4199-4e1e-42e3-a652-a0b7081b70a5 HTTP/1.1 Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgGfffld9wfyv1a2RtBCG4oTg4cAZ5y2BEKnqwaQcN9WnHMcCRgjtA42x90ry8kLuh5eao4xKx7LGQprVOZIlkzjPGEnj5-UwoErwl4A4CJiJUm3geJ370LcCbJEfYL-3cg3i6feI-oLwwfwxWTxzYt1ro3NceP6fwU-oM48sbGasA0 Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:58:24.143861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/117dafee744049e38fa222d261381e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_117dafee744049e38fa222d261381e71", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 5fb568fb6097445ea9c04eb33bbd48fd Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Volume 86df4199-4e1e-42e3-a652-a0b7081b70a5 could not be found. Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '86df4199-4e1e-42e3-a652-a0b7081b70a5'} Jun 15 15:58:24.145478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 86df4199-4e1e-42e3-a652-a0b7081b70a5 could not be found. (HTTP 404) (Request-ID: req-2f1dde91-7bc3-45c7-a450-3c45292cefc8) Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.146431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 15:58:24.147777 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 86df4199-4e1e-42e3-a652-a0b7081b70a5 could not be found. Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 15:58:24.149085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 86df4199-4e1e-42e3-a652-a0b7081b70a5 could not be found. Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 86df4199-4e1e-42e3-a652-a0b7081b70a5 could not be found. Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-90f4d5a2-6312-4d79-9f27-869b87f832ef tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Returning 404 to user: Volume 86df4199-4e1e-42e3-a652-a0b7081b70a5 could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-90f4d5a2-6312-4d79-9f27-869b87f832ef tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/86df4199-4e1e-42e3-a652-a0b7081b70a5" status: 404 len: 109 microversion: 2.1 time: 0.036217 Jun 15 15:58:24.150405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 406/800] 10.222.0.62 () {58 vars in 1247 bytes} [Wed Jun 15 15:58:24 2022] DELETE /compute/v2.1/os-volumes/86df4199-4e1e-42e3-a652-a0b7081b70a5 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:58:24.155059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a6259c67-07f9-46c8-95db-c68e747335c0 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Calling method '.version_select at 0x7fd8d830be50>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:24.182677 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-a6259c67-07f9-46c8-95db-c68e747335c0 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] HTTP exception thrown: Volume bfa0caa0-59bc-4392-a167-009456eede12 could not be found. Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a6259c67-07f9-46c8-95db-c68e747335c0 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Request method failure captured: Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/os-volumes/bfa0caa0-59bc-4392-a167-009456eede12 HTTP/1.1 Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgGfffld9wfyv1a2RtBCG4oTg4cAZ5y2BEKnqwaQcN9WnHMcCRgjtA42x90ry8kLuh5eao4xKx7LGQprVOZIlkzjPGEnj5-UwoErwl4A4CJiJUm3geJ370LcCbJEfYL-3cg3i6feI-oLwwfwxWTxzYt1ro3NceP6fwU-oM48sbGasA0 Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:58:24.186001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/117dafee744049e38fa222d261381e71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/117dafee744049e38fa222d261381e71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_117dafee744049e38fa222d261381e71", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 117dafee744049e38fa222d261381e71 Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-VolumesNegativeTest-933608239 Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 5fb568fb6097445ea9c04eb33bbd48fd Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-VolumesNegativeTest-933608239-project Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Volume bfa0caa0-59bc-4392-a167-009456eede12 could not be found. Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'bfa0caa0-59bc-4392-a167-009456eede12'} Jun 15 15:58:24.187599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bfa0caa0-59bc-4392-a167-009456eede12 could not be found. (HTTP 404) (Request-ID: req-f1986bc6-20e0-46c3-8d2b-224acc012bd9) Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.188544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 15:58:24.189836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bfa0caa0-59bc-4392-a167-009456eede12 could not be found. Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 15:58:24.191669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bfa0caa0-59bc-4392-a167-009456eede12 could not be found. Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bfa0caa0-59bc-4392-a167-009456eede12 could not be found. Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a6259c67-07f9-46c8-95db-c68e747335c0 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] Returning 404 to user: Volume bfa0caa0-59bc-4392-a167-009456eede12 could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a6259c67-07f9-46c8-95db-c68e747335c0 tempest-VolumesNegativeTest-933608239 tempest-VolumesNegativeTest-933608239-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/bfa0caa0-59bc-4392-a167-009456eede12" status: 404 len: 109 microversion: 2.1 time: 0.036406 Jun 15 15:58:24.194068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 395/801] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 15:58:24 2022] GET /compute/v2.1/os-volumes/bfa0caa0-59bc-4392-a167-009456eede12 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:58:44.145743 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:58:44.146496 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:58:44.150940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-90f45ba6-bb97-4daa-9b16-f541f26a9a36 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:44.151566 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-90f45ba6-bb97-4daa-9b16-f541f26a9a36 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:44.160860 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-90f45ba6-bb97-4daa-9b16-f541f26a9a36 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:44.161299 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-90f45ba6-bb97-4daa-9b16-f541f26a9a36 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:44.162040 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-90f45ba6-bb97-4daa-9b16-f541f26a9a36 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:44.162464 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-90f45ba6-bb97-4daa-9b16-f541f26a9a36 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:44.186206 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-90f45ba6-bb97-4daa-9b16-f541f26a9a36 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/ips" status: 200 len: 149 microversion: 2.1 time: 0.041941 Jun 15 15:58:44.186763 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 407/802] 10.222.0.62 () {58 vars in 1247 bytes} [Wed Jun 15 15:58:44 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:58:46.538256 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:58:46.539081 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:58:46.543819 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-55233925-fe07-4d5e-b850-3828e3e12dc8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9171244b-b7cf-45d3-9fe3-fbf54ee957c4"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:58:46.544910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-55233925-fe07-4d5e-b850-3828e3e12dc8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:46.552799 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55233925-fe07-4d5e-b850-3828e3e12dc8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:46.553192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55233925-fe07-4d5e-b850-3828e3e12dc8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:46.553954 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55233925-fe07-4d5e-b850-3828e3e12dc8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:46.554388 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55233925-fe07-4d5e-b850-3828e3e12dc8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:46.813639 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-55233925-fe07-4d5e-b850-3828e3e12dc8 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277007 Jun 15 15:58:46.814249 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 396/803] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 15:58:46 2022] POST /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:58:54.797011 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-863755872", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "networks": [{"uuid": "8fd801ac-5710-4516-974f-f1de1a231e33"}]}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:58:54.804163 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:58:54.804807 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=4 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:58:54.850485 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.network.neutron [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] validate_networks() for [('8fd801ac-5710-4516-974f-f1de1a231e33', None, None, None, None, None)] {{(pid=123934) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:58:55.191736 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Flavor limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:58:55.192151 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Image limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:58:55.192667 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Flavor pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:58:55.193070 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Image pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:58:55.193468 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:58:55.202784 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:55.203223 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:55.203997 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:55.204419 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:55.220326 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Getting quotas for project 4babb3ea9898402ba7898395d59b4beb. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:58:55.224239 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Getting quotas for user 00609e23ec8d4eadb9709b4e497810e3 and project 4babb3ea9898402ba7898395d59b4beb. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:58:55.234814 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Going to run 1 instances... {{(pid=123934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:58:55.237009 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:58:55.285520 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-49a4502a-95cf-4b89-a783-29b488d661eb tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492232 Jun 15 15:58:55.286283 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 408/804] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:58:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 15:58:55.297443 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e55f0f3f-7216-49b0-a196-a26566fd1ad9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:55.298146 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e55f0f3f-7216-49b0-a196-a26566fd1ad9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:55.368330 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-643e0674-e1e5-41b6-b7a0-59a07544a8b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9171244b-b7cf-45d3-9fe3-fbf54ee957c4"}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:58:55.369767 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-643e0674-e1e5-41b6-b7a0-59a07544a8b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:55.373158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e55f0f3f-7216-49b0-a196-a26566fd1ad9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:55.379373 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-643e0674-e1e5-41b6-b7a0-59a07544a8b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:55.379823 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-643e0674-e1e5-41b6-b7a0-59a07544a8b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:55.379949 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e55f0f3f-7216-49b0-a196-a26566fd1ad9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1213 microversion: 2.1 time: 0.087571 Jun 15 15:58:55.380503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 397/805] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:55 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:55.382223 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-643e0674-e1e5-41b6-b7a0-59a07544a8b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:55.382898 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-643e0674-e1e5-41b6-b7a0-59a07544a8b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:55.477608 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-643e0674-e1e5-41b6-b7a0-59a07544a8b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Invalid volume: volume 9171244b-b7cf-45d3-9fe3-fbf54ee957c4 is already attached to instances: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-643e0674-e1e5-41b6-b7a0-59a07544a8b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: POST /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments HTTP/1.1 Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 74 Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:58:55.479561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {"volumeAttachment": {"volumeId": "9171244b-b7cf-45d3-9fe3-fbf54ee957c4"}} Jun 15 15:58:55.481541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Invalid volume: volume 9171244b-b7cf-45d3-9fe3-fbf54ee957c4 is already attached to instances: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'server_id': '5bfc8df9-5cac-41ce-8af4-47483c7b5d95', 'body': {'volumeAttachment': {'volumeId': '9171244b-b7cf-45d3-9fe3-fbf54ee957c4'}}} Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9171244b-b7cf-45d3-9fe3-fbf54ee957c4 is already attached to instances: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:55.482363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9171244b-b7cf-45d3-9fe3-fbf54ee957c4 is already attached to instances: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:58:55.484890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:58:55.486567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:58:55.486567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:58:55.486567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:58:55.486567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9171244b-b7cf-45d3-9fe3-fbf54ee957c4 is already attached to instances: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 Jun 15 15:58:55.486567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:58:55.486567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-643e0674-e1e5-41b6-b7a0-59a07544a8b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 400 to user: Invalid volume: volume 9171244b-b7cf-45d3-9fe3-fbf54ee957c4 is already attached to instances: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:58:55.486567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-643e0674-e1e5-41b6-b7a0-59a07544a8b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119487 Jun 15 15:58:55.486567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 409/806] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 15:58:55 2022] POST /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 15 15:58:55.548437 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3f3ef709-68b9-4d0f-8f18-442fbfc63faa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:55.548934 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3f3ef709-68b9-4d0f-8f18-442fbfc63faa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:55.556185 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f3ef709-68b9-4d0f-8f18-442fbfc63faa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:55.556701 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f3ef709-68b9-4d0f-8f18-442fbfc63faa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:55.557557 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f3ef709-68b9-4d0f-8f18-442fbfc63faa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:55.557879 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f3ef709-68b9-4d0f-8f18-442fbfc63faa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:55.640901 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-3f3ef709-68b9-4d0f-8f18-442fbfc63faa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lazy-loading 'services' on Instance uuid 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:58:55.715590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3f3ef709-68b9-4d0f-8f18-442fbfc63faa tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments/9171244b-b7cf-45d3-9fe3-fbf54ee957c4" status: 202 len: 0 microversion: 2.1 time: 0.170831 Jun 15 15:58:55.716204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 398/807] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 15:58:55 2022] DELETE /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments/9171244b-b7cf-45d3-9fe3-fbf54ee957c4 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:58:55.724563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4ea3d830-c7c2-49d9-bcf2-94131e481063 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:55.725576 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4ea3d830-c7c2-49d9-bcf2-94131e481063 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:55.733244 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4ea3d830-c7c2-49d9-bcf2-94131e481063 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:55.734021 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4ea3d830-c7c2-49d9-bcf2-94131e481063 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:55.735098 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4ea3d830-c7c2-49d9-bcf2-94131e481063 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:55.735731 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4ea3d830-c7c2-49d9-bcf2-94131e481063 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:55.768975 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4ea3d830-c7c2-49d9-bcf2-94131e481063 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048286 Jun 15 15:58:55.769535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 410/808] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:58:55 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:58:56.398082 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-16b4a91c-7bf5-4e2d-be52-5c80a04cec6c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:56.398874 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-16b4a91c-7bf5-4e2d-be52-5c80a04cec6c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:56.405846 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-16b4a91c-7bf5-4e2d-be52-5c80a04cec6c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:56.406295 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-16b4a91c-7bf5-4e2d-be52-5c80a04cec6c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:56.407133 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-16b4a91c-7bf5-4e2d-be52-5c80a04cec6c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:56.407570 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-16b4a91c-7bf5-4e2d-be52-5c80a04cec6c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:56.475158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-16b4a91c-7bf5-4e2d-be52-5c80a04cec6c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:56.482560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-16b4a91c-7bf5-4e2d-be52-5c80a04cec6c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1265 microversion: 2.1 time: 0.089510 Jun 15 15:58:56.483142 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 399/809] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:56 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:56.780531 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d40b11f0-2110-49cc-afcf-176df38158df tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:56.781453 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d40b11f0-2110-49cc-afcf-176df38158df tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:56.788410 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d40b11f0-2110-49cc-afcf-176df38158df tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:56.789095 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d40b11f0-2110-49cc-afcf-176df38158df tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:56.789942 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d40b11f0-2110-49cc-afcf-176df38158df tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:56.790374 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d40b11f0-2110-49cc-afcf-176df38158df tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:56.824405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d40b11f0-2110-49cc-afcf-176df38158df tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047740 Jun 15 15:58:56.825565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 411/810] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:58:56 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:58:57.499293 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c35962ca-01e4-4db8-b4bd-e16935c9df99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:57.500122 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c35962ca-01e4-4db8-b4bd-e16935c9df99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:57.506838 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c35962ca-01e4-4db8-b4bd-e16935c9df99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:57.507297 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c35962ca-01e4-4db8-b4bd-e16935c9df99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:57.508066 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c35962ca-01e4-4db8-b4bd-e16935c9df99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:57.508501 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c35962ca-01e4-4db8-b4bd-e16935c9df99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:57.586695 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c35962ca-01e4-4db8-b4bd-e16935c9df99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:57.595026 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c35962ca-01e4-4db8-b4bd-e16935c9df99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1271 microversion: 2.1 time: 0.099369 Jun 15 15:58:57.595598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 400/811] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:57 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:57.836502 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-edda7cc7-a77d-4d84-989a-d728928dd832 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:57.837424 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-edda7cc7-a77d-4d84-989a-d728928dd832 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:57.844659 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-edda7cc7-a77d-4d84-989a-d728928dd832 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:57.845108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-edda7cc7-a77d-4d84-989a-d728928dd832 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:57.845873 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-edda7cc7-a77d-4d84-989a-d728928dd832 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:57.846304 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-edda7cc7-a77d-4d84-989a-d728928dd832 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:57.881369 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-edda7cc7-a77d-4d84-989a-d728928dd832 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049190 Jun 15 15:58:57.881928 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 412/812] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:58:57 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 15 15:58:57.946392 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-94b58b94-c603-4ea9-9c92-b04b744c5442 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:57.946915 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-94b58b94-c603-4ea9-9c92-b04b744c5442 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:57.953399 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94b58b94-c603-4ea9-9c92-b04b744c5442 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:57.953856 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94b58b94-c603-4ea9-9c92-b04b744c5442 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:57.954581 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94b58b94-c603-4ea9-9c92-b04b744c5442 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:57.955036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-94b58b94-c603-4ea9-9c92-b04b744c5442 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:57.981286 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-94b58b94-c603-4ea9-9c92-b04b744c5442 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Going to try to terminate instance {{(pid=123935) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:58:58.070382 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-94b58b94-c603-4ea9-9c92-b04b744c5442 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 204 len: 0 microversion: 2.1 time: 0.128318 Jun 15 15:58:58.071045 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 401/813] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:58:57 2022] DELETE /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:58:58.079982 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-57ed7da6-a1bd-48d8-a52b-760f4c768c39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:58.080680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-57ed7da6-a1bd-48d8-a52b-760f4c768c39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:58.086860 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57ed7da6-a1bd-48d8-a52b-760f4c768c39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:58.087233 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57ed7da6-a1bd-48d8-a52b-760f4c768c39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:58.088096 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57ed7da6-a1bd-48d8-a52b-760f4c768c39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:58.088521 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-57ed7da6-a1bd-48d8-a52b-760f4c768c39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:58.335684 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-57ed7da6-a1bd-48d8-a52b-760f4c768c39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:58.343666 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-57ed7da6-a1bd-48d8-a52b-760f4c768c39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1679 microversion: 2.1 time: 0.267542 Jun 15 15:58:58.344335 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 413/814] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:58 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:58:58.617840 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a132e691-b2c8-498e-89d8-eb3dc57263dd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:58.618535 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a132e691-b2c8-498e-89d8-eb3dc57263dd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:58.625842 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a132e691-b2c8-498e-89d8-eb3dc57263dd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:58.626287 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a132e691-b2c8-498e-89d8-eb3dc57263dd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:58.627088 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a132e691-b2c8-498e-89d8-eb3dc57263dd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:58.627519 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a132e691-b2c8-498e-89d8-eb3dc57263dd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:58.721156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-41867226-7410-4a16-a79e-eb2ef12a11ff req-7593d826-22b7-434c-80a2-32bce35169b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eef58215-9aca-49c3-a96f-2554bc62676c", "tag": "828204a4-1d3a-467f-825b-56b41c899865"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:58:58.729167 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-41867226-7410-4a16-a79e-eb2ef12a11ff req-7593d826-22b7-434c-80a2-32bce35169b8 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:58.729675 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-41867226-7410-4a16-a79e-eb2ef12a11ff req-7593d826-22b7-434c-80a2-32bce35169b8 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:58.742387 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-41867226-7410-4a16-a79e-eb2ef12a11ff req-7593d826-22b7-434c-80a2-32bce35169b8 service nova] Creating event network-changed:828204a4-1d3a-467f-825b-56b41c899865 for instance eef58215-9aca-49c3-a96f-2554bc62676c on hv-cinder-84599 Jun 15 15:58:58.747977 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-41867226-7410-4a16-a79e-eb2ef12a11ff req-7593d826-22b7-434c-80a2-32bce35169b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030554 Jun 15 15:58:58.748764 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 414/815] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:58:58.806603 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a132e691-b2c8-498e-89d8-eb3dc57263dd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:58.814604 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a132e691-b2c8-498e-89d8-eb3dc57263dd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1313 microversion: 2.1 time: 0.200997 Jun 15 15:58:58.815212 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 402/816] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:58 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:59.361305 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a5596474-11d0-415b-b31a-8a526d993789 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:59.362026 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a5596474-11d0-415b-b31a-8a526d993789 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:59.368686 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a5596474-11d0-415b-b31a-8a526d993789 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:59.369134 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a5596474-11d0-415b-b31a-8a526d993789 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:59.369888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a5596474-11d0-415b-b31a-8a526d993789 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:59.370322 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a5596474-11d0-415b-b31a-8a526d993789 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:59.498778 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a5596474-11d0-415b-b31a-8a526d993789 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:59.506157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a5596474-11d0-415b-b31a-8a526d993789 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1679 microversion: 2.1 time: 0.149055 Jun 15 15:58:59.506715 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 415/817] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:59 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:58:59.831164 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-71e717f1-0d81-4c6d-b1f1-a5298aa73afd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:58:59.831772 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-71e717f1-0d81-4c6d-b1f1-a5298aa73afd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:58:59.838229 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-71e717f1-0d81-4c6d-b1f1-a5298aa73afd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:59.838673 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-71e717f1-0d81-4c6d-b1f1-a5298aa73afd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:59.839457 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-71e717f1-0d81-4c6d-b1f1-a5298aa73afd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:58:59.839886 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-71e717f1-0d81-4c6d-b1f1-a5298aa73afd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:58:59.968096 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-71e717f1-0d81-4c6d-b1f1-a5298aa73afd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:58:59.975581 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-71e717f1-0d81-4c6d-b1f1-a5298aa73afd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1313 microversion: 2.1 time: 0.148325 Jun 15 15:58:59.976143 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 403/818] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:58:59 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:00.523144 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0ee22998-b09f-4d83-9b8a-61acfa405a0a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:00.523753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0ee22998-b09f-4d83-9b8a-61acfa405a0a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:00.530013 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0ee22998-b09f-4d83-9b8a-61acfa405a0a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:00.530464 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0ee22998-b09f-4d83-9b8a-61acfa405a0a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:00.531254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0ee22998-b09f-4d83-9b8a-61acfa405a0a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:00.531691 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0ee22998-b09f-4d83-9b8a-61acfa405a0a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:00.731501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0ee22998-b09f-4d83-9b8a-61acfa405a0a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:00.739011 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0ee22998-b09f-4d83-9b8a-61acfa405a0a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1679 microversion: 2.1 time: 0.219677 Jun 15 15:59:00.739576 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 416/819] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:00 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:00.995241 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3d882938-d5c2-4729-8a34-c23e39dfe237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:00.997257 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3d882938-d5c2-4729-8a34-c23e39dfe237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:01.007725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3d882938-d5c2-4729-8a34-c23e39dfe237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:01.008169 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3d882938-d5c2-4729-8a34-c23e39dfe237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:01.009054 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3d882938-d5c2-4729-8a34-c23e39dfe237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:01.009491 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3d882938-d5c2-4729-8a34-c23e39dfe237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:01.148218 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3d882938-d5c2-4729-8a34-c23e39dfe237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:01.156497 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3d882938-d5c2-4729-8a34-c23e39dfe237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1313 microversion: 2.1 time: 0.167478 Jun 15 15:59:01.157060 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 404/820] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:00 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:01.592284 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-04ff54a3-1900-45cd-b9dc-e793c5339fc5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:01.593014 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-04ff54a3-1900-45cd-b9dc-e793c5339fc5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:01.600115 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-04ff54a3-1900-45cd-b9dc-e793c5339fc5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:01.600558 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-04ff54a3-1900-45cd-b9dc-e793c5339fc5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:01.601313 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-04ff54a3-1900-45cd-b9dc-e793c5339fc5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:01.601865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-04ff54a3-1900-45cd-b9dc-e793c5339fc5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:01.610332 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-0d3bf341-3aa4-4dcf-b722-862ffb9d69e6 req-f86745ed-2212-439e-8527-3ef672b0a6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfc8df9-5cac-41ce-8af4-47483c7b5d95", "name": "network-vif-deleted", "tag": "874420e5-c070-43f3-99c3-c445ee22fedf"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:01.618148 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-0d3bf341-3aa4-4dcf-b722-862ffb9d69e6 req-f86745ed-2212-439e-8527-3ef672b0a6b4 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:01.618587 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-0d3bf341-3aa4-4dcf-b722-862ffb9d69e6 req-f86745ed-2212-439e-8527-3ef672b0a6b4 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:01.627335 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-04ff54a3-1900-45cd-b9dc-e793c5339fc5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/ips" status: 200 len: 152 microversion: 2.20 time: 0.039399 Jun 15 15:59:01.630766 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 417/821] 10.222.0.62 () {60 vars in 1288 bytes} [Wed Jun 15 15:59:01 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 15:59:01.631689 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-0d3bf341-3aa4-4dcf-b722-862ffb9d69e6 req-f86745ed-2212-439e-8527-3ef672b0a6b4 service nova] Creating event network-vif-deleted:874420e5-c070-43f3-99c3-c445ee22fedf for instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 on hv-cinder-84599 Jun 15 15:59:01.638018 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-0d3bf341-3aa4-4dcf-b722-862ffb9d69e6 req-f86745ed-2212-439e-8527-3ef672b0a6b4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030271 Jun 15 15:59:01.638148 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 405/822] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:59:01.759770 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b730421b-1831-4f66-8379-77fb9f7c1ceb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:01.760384 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b730421b-1831-4f66-8379-77fb9f7c1ceb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:01.769184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b730421b-1831-4f66-8379-77fb9f7c1ceb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:01.770047 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b730421b-1831-4f66-8379-77fb9f7c1ceb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:01.771229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b730421b-1831-4f66-8379-77fb9f7c1ceb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:01.771480 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b730421b-1831-4f66-8379-77fb9f7c1ceb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:01.846031 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b730421b-1831-4f66-8379-77fb9f7c1ceb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:01.854767 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b730421b-1831-4f66-8379-77fb9f7c1ceb tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1612 microversion: 2.1 time: 0.101254 Jun 15 15:59:01.876507 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 418/823] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:01 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1612 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:02.173811 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-23047344-fa54-4ee9-80ce-f171263acf77 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:02.174499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-23047344-fa54-4ee9-80ce-f171263acf77 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:02.181112 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23047344-fa54-4ee9-80ce-f171263acf77 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:02.181665 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23047344-fa54-4ee9-80ce-f171263acf77 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:02.182418 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23047344-fa54-4ee9-80ce-f171263acf77 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:02.182869 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23047344-fa54-4ee9-80ce-f171263acf77 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:02.314089 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-23047344-fa54-4ee9-80ce-f171263acf77 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:02.322976 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-23047344-fa54-4ee9-80ce-f171263acf77 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1313 microversion: 2.1 time: 0.153207 Jun 15 15:59:02.323659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 406/824] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:02 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:02.872784 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b427fd96-541a-4c78-a350-1ac6ef0cb5e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:02.873421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b427fd96-541a-4c78-a350-1ac6ef0cb5e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:02.879917 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b427fd96-541a-4c78-a350-1ac6ef0cb5e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:02.880362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b427fd96-541a-4c78-a350-1ac6ef0cb5e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:02.881112 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b427fd96-541a-4c78-a350-1ac6ef0cb5e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:02.881541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b427fd96-541a-4c78-a350-1ac6ef0cb5e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:02.945457 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b427fd96-541a-4c78-a350-1ac6ef0cb5e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:02.952975 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b427fd96-541a-4c78-a350-1ac6ef0cb5e2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1612 microversion: 2.1 time: 0.084169 Jun 15 15:59:02.953540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 419/825] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:02 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1612 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:03.340407 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-667bc107-607f-42f2-a149-b52a245a5789 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:03.340939 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-667bc107-607f-42f2-a149-b52a245a5789 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:03.347501 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-667bc107-607f-42f2-a149-b52a245a5789 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:03.347954 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-667bc107-607f-42f2-a149-b52a245a5789 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:03.348717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-667bc107-607f-42f2-a149-b52a245a5789 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:03.349152 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-667bc107-607f-42f2-a149-b52a245a5789 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:03.483570 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-667bc107-607f-42f2-a149-b52a245a5789 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:03.490910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-667bc107-607f-42f2-a149-b52a245a5789 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1313 microversion: 2.1 time: 0.155045 Jun 15 15:59:03.491471 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 407/826] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:03 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:03.765556 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-59b34b1b-8e83-4833-9815-bac3663a6399 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:03.766080 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-59b34b1b-8e83-4833-9815-bac3663a6399 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:03.772098 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-59b34b1b-8e83-4833-9815-bac3663a6399 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:03.772541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-59b34b1b-8e83-4833-9815-bac3663a6399 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:03.773293 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-59b34b1b-8e83-4833-9815-bac3663a6399 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:03.773721 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-59b34b1b-8e83-4833-9815-bac3663a6399 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:03.795988 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-59b34b1b-8e83-4833-9815-bac3663a6399 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lazy-loading 'flavor' on Instance uuid 1c4bb33d-2d9f-4620-9e94-f28e12cd604f {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:59:03.969465 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c35b9ebc-6264-43ae-bf87-8d666b6f3045 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:03.970073 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c35b9ebc-6264-43ae-bf87-8d666b6f3045 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:03.976215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c35b9ebc-6264-43ae-bf87-8d666b6f3045 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:03.976651 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c35b9ebc-6264-43ae-bf87-8d666b6f3045 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:03.977397 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c35b9ebc-6264-43ae-bf87-8d666b6f3045 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:03.977819 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c35b9ebc-6264-43ae-bf87-8d666b6f3045 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:04.058447 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-59b34b1b-8e83-4833-9815-bac3663a6399 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "POST /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/action" status: 202 len: 0 microversion: 2.20 time: 0.297231 Jun 15 15:59:04.062713 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 420/827] 10.222.0.62 () {62 vars in 1318 bytes} [Wed Jun 15 15:59:03 2022] POST /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:59:04.068442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1087e8ba-c97c-4b83-837e-af6db0d58702 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:04.069140 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1087e8ba-c97c-4b83-837e-af6db0d58702 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:04.076028 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1087e8ba-c97c-4b83-837e-af6db0d58702 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:04.076471 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1087e8ba-c97c-4b83-837e-af6db0d58702 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:04.077303 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1087e8ba-c97c-4b83-837e-af6db0d58702 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:04.077735 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1087e8ba-c97c-4b83-837e-af6db0d58702 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:04.223980 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c35b9ebc-6264-43ae-bf87-8d666b6f3045 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:04.231907 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c35b9ebc-6264-43ae-bf87-8d666b6f3045 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 200 len: 1325 microversion: 2.1 time: 0.266413 Jun 15 15:59:04.232469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 408/828] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:03 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 1325 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:59:04.244816 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1087e8ba-c97c-4b83-837e-af6db0d58702 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:04.252678 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1087e8ba-c97c-4b83-837e-af6db0d58702 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:04.254181 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1087e8ba-c97c-4b83-837e-af6db0d58702 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:04.255352 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1087e8ba-c97c-4b83-837e-af6db0d58702 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.191245 Jun 15 15:59:04.255903 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 421/829] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:04 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:04.507834 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-05e9e6f0-c792-4bb6-9c67-01657bef248f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:04.508469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-05e9e6f0-c792-4bb6-9c67-01657bef248f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:04.515491 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05e9e6f0-c792-4bb6-9c67-01657bef248f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:04.515939 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05e9e6f0-c792-4bb6-9c67-01657bef248f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:04.516687 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05e9e6f0-c792-4bb6-9c67-01657bef248f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:04.517158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05e9e6f0-c792-4bb6-9c67-01657bef248f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:04.644724 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-05e9e6f0-c792-4bb6-9c67-01657bef248f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:04.652108 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-05e9e6f0-c792-4bb6-9c67-01657bef248f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1313 microversion: 2.1 time: 0.148549 Jun 15 15:59:04.652669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 409/830] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:04 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:05.249287 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-55175f88-2351-4ccc-af5d-808f4e9695b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:05.249889 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-55175f88-2351-4ccc-af5d-808f4e9695b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:05.252303 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:05.252982 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=6 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:05.258654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-55175f88-2351-4ccc-af5d-808f4e9695b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:05.259122 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-55175f88-2351-4ccc-af5d-808f4e9695b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:05.259885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-55175f88-2351-4ccc-af5d-808f4e9695b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:05.260314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-55175f88-2351-4ccc-af5d-808f4e9695b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:05.273502 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0a682673-0c8c-46b1-991b-1b86303b71d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:05.274108 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0a682673-0c8c-46b1-991b-1b86303b71d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:05.276364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-55175f88-2351-4ccc-af5d-808f4e9695b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-55175f88-2351-4ccc-af5d-808f4e9695b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 HTTP/1.1 Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 15:59:05.277996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 15:59:05.279482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '5bfc8df9-5cac-41ce-8af4-47483c7b5d95'} Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:59:05.280425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 15:59:05.282418 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 15:59:05.284872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-55175f88-2351-4ccc-af5d-808f4e9695b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:59:05.284872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-55175f88-2351-4ccc-af5d-808f4e9695b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 404 len: 111 microversion: 2.1 time: 0.034540 Jun 15 15:59:05.284872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 422/831] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:05 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 15:59:05.285133 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0a682673-0c8c-46b1-991b-1b86303b71d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:05.285133 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0a682673-0c8c-46b1-991b-1b86303b71d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:05.285133 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0a682673-0c8c-46b1-991b-1b86303b71d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:05.285133 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0a682673-0c8c-46b1-991b-1b86303b71d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:05.289440 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4415361d-b914-451a-beec-bf1105106c1c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '.version_select at 0x7fd8dc121430>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:05.301514 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:05.311918 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4415361d-b914-451a-beec-bf1105106c1c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-785081587" status: 202 len: 0 microversion: 2.1 time: 0.027254 Jun 15 15:59:05.312797 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 423/832] 10.222.0.62 () {58 vars in 1217 bytes} [Wed Jun 15 15:59:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-785081587 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 15:59:05.377521 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:05.485544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0a682673-0c8c-46b1-991b-1b86303b71d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:05.493546 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0a682673-0c8c-46b1-991b-1b86303b71d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:05.495069 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0a682673-0c8c-46b1-991b-1b86303b71d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:05.496767 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0a682673-0c8c-46b1-991b-1b86303b71d2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.226711 Jun 15 15:59:05.497330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 410/833] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:05 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:59:05.669469 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-10d47628-f6f2-42ff-a96f-247c320159ec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:05.669971 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-10d47628-f6f2-42ff-a96f-247c320159ec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:05.676323 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-10d47628-f6f2-42ff-a96f-247c320159ec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:05.676774 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-10d47628-f6f2-42ff-a96f-247c320159ec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:05.677536 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-10d47628-f6f2-42ff-a96f-247c320159ec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:05.677964 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-10d47628-f6f2-42ff-a96f-247c320159ec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:05.805549 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-10d47628-f6f2-42ff-a96f-247c320159ec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:05.813654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-10d47628-f6f2-42ff-a96f-247c320159ec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1313 microversion: 2.1 time: 0.148791 Jun 15 15:59:05.815892 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 424/834] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:05 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:06.004932 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fc73b4b4-9cb0-4c57-a9af-f7760d0bef9b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: .version_select at 0x7fd8d37990d0>, body: {"keypair": {"name": "tempest-keypair-705464102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMlitvTw+osnUcJflflxjRLLGj1km+M1mOYodrv8phdUEVkeJE8IVtgNpo2pvkMEPKKGsZ+zorbFbsvqIZ7UmbWrJ9+JPjvluXlfu8XMrtUXktj1wdQZpF8vMXcd8O5qQ=="}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:06.020029 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-fc73b4b4-9cb0-4c57-a9af-f7760d0bef9b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for project 0496c4ee9cdf486684000904876d0b6b. Resources: {'key_pairs'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:59:06.023852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-fc73b4b4-9cb0-4c57-a9af-f7760d0bef9b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for user fb838f931b7748e2baf6c2315d3cbd75 and project 0496c4ee9cdf486684000904876d0b6b. Resources: {'key_pairs'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:59:06.045627 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fc73b4b4-9cb0-4c57-a9af-f7760d0bef9b tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044646 Jun 15 15:59:06.046210 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 411/835] 10.222.0.62 () {60 vars in 1158 bytes} [Wed Jun 15 15:59:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:06.515682 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-132c05f2-a55d-4d92-8a5b-f4a3c27667ae tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:06.516337 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-132c05f2-a55d-4d92-8a5b-f4a3c27667ae tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:06.523547 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-132c05f2-a55d-4d92-8a5b-f4a3c27667ae tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:06.524226 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-132c05f2-a55d-4d92-8a5b-f4a3c27667ae tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:06.525047 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-132c05f2-a55d-4d92-8a5b-f4a3c27667ae tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:06.525717 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-132c05f2-a55d-4d92-8a5b-f4a3c27667ae tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:06.702895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-fe3ed836-1b86-418a-9f1b-282bc3a5aa56 req-6a97b393-a596-45a1-ae3b-cbae6fde34f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef58215-9aca-49c3-a96f-2554bc62676c", "name": "network-vif-plugged", "status": "completed", "tag": "828204a4-1d3a-467f-825b-56b41c899865"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:06.714504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-fe3ed836-1b86-418a-9f1b-282bc3a5aa56 req-6a97b393-a596-45a1-ae3b-cbae6fde34f1 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:06.715937 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-fe3ed836-1b86-418a-9f1b-282bc3a5aa56 req-6a97b393-a596-45a1-ae3b-cbae6fde34f1 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:06.728829 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-fe3ed836-1b86-418a-9f1b-282bc3a5aa56 req-6a97b393-a596-45a1-ae3b-cbae6fde34f1 service nova] Creating event network-vif-plugged:828204a4-1d3a-467f-825b-56b41c899865 for instance eef58215-9aca-49c3-a96f-2554bc62676c on hv-cinder-84599 Jun 15 15:59:06.737235 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-fe3ed836-1b86-418a-9f1b-282bc3a5aa56 req-6a97b393-a596-45a1-ae3b-cbae6fde34f1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038648 Jun 15 15:59:06.738175 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 412/836] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:06.751213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-132c05f2-a55d-4d92-8a5b-f4a3c27667ae tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:06.756422 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:06.763548 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-132c05f2-a55d-4d92-8a5b-f4a3c27667ae tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:06.765459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-132c05f2-a55d-4d92-8a5b-f4a3c27667ae tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:06.766684 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-132c05f2-a55d-4d92-8a5b-f4a3c27667ae tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.254945 Jun 15 15:59:06.767654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 425/837] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:06 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:06.830793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-542cf340-fd88-43dd-8458-7465e99621c3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:06.831504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-542cf340-fd88-43dd-8458-7465e99621c3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:06.837762 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-542cf340-fd88-43dd-8458-7465e99621c3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:06.838224 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-542cf340-fd88-43dd-8458-7465e99621c3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:06.839007 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-542cf340-fd88-43dd-8458-7465e99621c3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:06.839604 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-542cf340-fd88-43dd-8458-7465e99621c3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:07.374477 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-542cf340-fd88-43dd-8458-7465e99621c3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:07.381768 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-542cf340-fd88-43dd-8458-7465e99621c3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1313 microversion: 2.1 time: 0.555399 Jun 15 15:59:07.391785 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 413/838] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:06 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:07.786165 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b65494e8-1fa2-498a-a6c0-db226eec2945 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:07.786794 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b65494e8-1fa2-498a-a6c0-db226eec2945 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:07.790897 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1807818216", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "597f7e5d-558d-4aed-88e5-ecbc7c009bb7"}], "security_groups": [{"name": "tempest-securitygroup--1525091689"}], "key_name": "tempest-keypair-705464102", "user_data": "}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:07.794364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b65494e8-1fa2-498a-a6c0-db226eec2945 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:07.794829 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b65494e8-1fa2-498a-a6c0-db226eec2945 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:07.795593 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b65494e8-1fa2-498a-a6c0-db226eec2945 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:07.796027 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b65494e8-1fa2-498a-a6c0-db226eec2945 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:07.931898 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] validate_networks() for [('597f7e5d-558d-4aed-88e5-ecbc7c009bb7', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:59:07.983510 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b65494e8-1fa2-498a-a6c0-db226eec2945 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:07.991464 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b65494e8-1fa2-498a-a6c0-db226eec2945 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:07.992987 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b65494e8-1fa2-498a-a6c0-db226eec2945 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:07.994131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b65494e8-1fa2-498a-a6c0-db226eec2945 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.212703 Jun 15 15:59:07.994696 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 426/839] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:07 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:08.309212 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:59:08.309627 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:59:08.310092 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:59:08.310485 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:59:08.310924 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:59:08.319856 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:08.320443 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:08.321610 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:08.322156 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:08.338400 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for project 0496c4ee9cdf486684000904876d0b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:59:08.342307 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Getting quotas for user fb838f931b7748e2baf6c2315d3cbd75 and project 0496c4ee9cdf486684000904876d0b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:59:08.352902 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:59:08.355638 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:59:08.399381 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-436d729d-d02e-4167-81fa-9760b17f07a9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:08.400044 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-436d729d-d02e-4167-81fa-9760b17f07a9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:08.400183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a9fc52e6-5bb0-426a-a660-81bb8c11df24 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613644 Jun 15 15:59:08.401090 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 414/840] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:59:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:59:08.406169 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-436d729d-d02e-4167-81fa-9760b17f07a9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:08.406616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-436d729d-d02e-4167-81fa-9760b17f07a9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:08.407405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-436d729d-d02e-4167-81fa-9760b17f07a9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:08.407828 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-436d729d-d02e-4167-81fa-9760b17f07a9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:08.418360 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-600fa478-1bd7-4d27-8c6e-267fbc5e8e85 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:08.419147 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-600fa478-1bd7-4d27-8c6e-267fbc5e8e85 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:08.481669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-600fa478-1bd7-4d27-8c6e-267fbc5e8e85 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:08.488747 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-600fa478-1bd7-4d27-8c6e-267fbc5e8e85 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1241 microversion: 2.1 time: 0.076837 Jun 15 15:59:08.489389 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 415/841] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:08 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:08.566790 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-436d729d-d02e-4167-81fa-9760b17f07a9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:08.575150 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-436d729d-d02e-4167-81fa-9760b17f07a9 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1313 microversion: 2.1 time: 0.179546 Jun 15 15:59:08.575714 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 427/842] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:08 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:59:09.012574 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b776f99f-037e-44f8-bd8a-e3ee076737ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:09.013411 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b776f99f-037e-44f8-bd8a-e3ee076737ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:09.020064 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b776f99f-037e-44f8-bd8a-e3ee076737ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:09.020514 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b776f99f-037e-44f8-bd8a-e3ee076737ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:09.021358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b776f99f-037e-44f8-bd8a-e3ee076737ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:09.021791 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b776f99f-037e-44f8-bd8a-e3ee076737ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:09.170326 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b776f99f-037e-44f8-bd8a-e3ee076737ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:09.178284 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b776f99f-037e-44f8-bd8a-e3ee076737ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:09.179803 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b776f99f-037e-44f8-bd8a-e3ee076737ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:09.180950 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b776f99f-037e-44f8-bd8a-e3ee076737ad tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.172860 Jun 15 15:59:09.181529 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 416/843] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:09 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:09.506544 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-509213d2-d4d0-46bf-ab11-9c310b5641b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:09.507113 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-509213d2-d4d0-46bf-ab11-9c310b5641b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:09.514579 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-509213d2-d4d0-46bf-ab11-9c310b5641b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:09.515050 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-509213d2-d4d0-46bf-ab11-9c310b5641b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:09.515816 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-509213d2-d4d0-46bf-ab11-9c310b5641b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:09.516251 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-509213d2-d4d0-46bf-ab11-9c310b5641b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:09.576224 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-509213d2-d4d0-46bf-ab11-9c310b5641b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:09.583625 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-509213d2-d4d0-46bf-ab11-9c310b5641b3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1293 microversion: 2.1 time: 0.081286 Jun 15 15:59:09.584181 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 428/844] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:09 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:09.591441 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-be59827d-c7d1-4f8a-a915-191f7fe91237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:09.592051 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-be59827d-c7d1-4f8a-a915-191f7fe91237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:09.597988 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-be59827d-c7d1-4f8a-a915-191f7fe91237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:09.598429 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-be59827d-c7d1-4f8a-a915-191f7fe91237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:09.599211 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-be59827d-c7d1-4f8a-a915-191f7fe91237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:09.599638 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-be59827d-c7d1-4f8a-a915-191f7fe91237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:09.729753 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-be59827d-c7d1-4f8a-a915-191f7fe91237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:09.737470 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-be59827d-c7d1-4f8a-a915-191f7fe91237 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1496 microversion: 2.1 time: 0.149796 Jun 15 15:59:09.738035 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 417/845] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:09 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1496 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:10.199432 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-afdfc4cb-685c-41e1-b1e7-ddf31c214712 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:10.200035 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-afdfc4cb-685c-41e1-b1e7-ddf31c214712 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:10.205927 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-afdfc4cb-685c-41e1-b1e7-ddf31c214712 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:10.206366 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-afdfc4cb-685c-41e1-b1e7-ddf31c214712 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:10.207147 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-afdfc4cb-685c-41e1-b1e7-ddf31c214712 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:10.207629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-afdfc4cb-685c-41e1-b1e7-ddf31c214712 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:10.330059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-53561441-1b43-45cc-93bf-1a692da90f7a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:10.330763 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-53561441-1b43-45cc-93bf-1a692da90f7a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:10.337240 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-53561441-1b43-45cc-93bf-1a692da90f7a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:10.337685 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-53561441-1b43-45cc-93bf-1a692da90f7a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:10.338441 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-53561441-1b43-45cc-93bf-1a692da90f7a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:10.338895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-53561441-1b43-45cc-93bf-1a692da90f7a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:10.345234 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-afdfc4cb-685c-41e1-b1e7-ddf31c214712 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:10.353210 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-afdfc4cb-685c-41e1-b1e7-ddf31c214712 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:10.355139 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-afdfc4cb-685c-41e1-b1e7-ddf31c214712 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:10.356915 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-afdfc4cb-685c-41e1-b1e7-ddf31c214712 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.161591 Jun 15 15:59:10.357547 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 429/846] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:10 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:10.368348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-53561441-1b43-45cc-93bf-1a692da90f7a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Going to try to terminate instance {{(pid=123935) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:59:10.444950 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-53561441-1b43-45cc-93bf-1a692da90f7a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 204 len: 0 microversion: 2.1 time: 0.120161 Jun 15 15:59:10.445744 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 418/847] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:59:10 2022] DELETE /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:59:10.453671 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-77def231-b133-4d04-abdd-01b670c88208 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:10.454279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-77def231-b133-4d04-abdd-01b670c88208 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:10.460344 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-77def231-b133-4d04-abdd-01b670c88208 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:10.460819 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-77def231-b133-4d04-abdd-01b670c88208 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:10.461762 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-77def231-b133-4d04-abdd-01b670c88208 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:10.462363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-77def231-b133-4d04-abdd-01b670c88208 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:10.601359 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6617e58d-d0d4-4e9a-b0aa-dfd90bea97f2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:10.602614 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6617e58d-d0d4-4e9a-b0aa-dfd90bea97f2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:10.609008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6617e58d-d0d4-4e9a-b0aa-dfd90bea97f2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:10.609637 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6617e58d-d0d4-4e9a-b0aa-dfd90bea97f2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:10.610406 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6617e58d-d0d4-4e9a-b0aa-dfd90bea97f2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:10.610876 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6617e58d-d0d4-4e9a-b0aa-dfd90bea97f2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:10.689773 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6617e58d-d0d4-4e9a-b0aa-dfd90bea97f2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:10.694151 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-77def231-b133-4d04-abdd-01b670c88208 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:10.697254 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6617e58d-d0d4-4e9a-b0aa-dfd90bea97f2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1311 microversion: 2.1 time: 0.100373 Jun 15 15:59:10.697825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 419/848] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:10 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:59:10.702109 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-77def231-b133-4d04-abdd-01b670c88208 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1502 microversion: 2.1 time: 0.252299 Jun 15 15:59:10.702912 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 430/849] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:10 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1502 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:11.376482 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1f7fe52c-e8aa-415b-8b62-b8a224fcc4ed tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:11.377085 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1f7fe52c-e8aa-415b-8b62-b8a224fcc4ed tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:11.383561 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1f7fe52c-e8aa-415b-8b62-b8a224fcc4ed tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:11.384006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1f7fe52c-e8aa-415b-8b62-b8a224fcc4ed tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:11.384757 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1f7fe52c-e8aa-415b-8b62-b8a224fcc4ed tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:11.385190 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1f7fe52c-e8aa-415b-8b62-b8a224fcc4ed tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:11.512988 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1f7fe52c-e8aa-415b-8b62-b8a224fcc4ed tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:11.523628 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1f7fe52c-e8aa-415b-8b62-b8a224fcc4ed tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:11.525142 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1f7fe52c-e8aa-415b-8b62-b8a224fcc4ed tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:11.526400 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1f7fe52c-e8aa-415b-8b62-b8a224fcc4ed tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.153873 Jun 15 15:59:11.527851 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 420/850] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:11 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:11.715024 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c0d38bab-d8a8-41d5-9bc4-a84f6269380c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:11.715632 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c0d38bab-d8a8-41d5-9bc4-a84f6269380c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:11.718598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9050654a-1854-460a-9a3e-3c8f9cbafd40 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:11.719239 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9050654a-1854-460a-9a3e-3c8f9cbafd40 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:11.722237 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c0d38bab-d8a8-41d5-9bc4-a84f6269380c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:11.722684 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c0d38bab-d8a8-41d5-9bc4-a84f6269380c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:11.723465 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c0d38bab-d8a8-41d5-9bc4-a84f6269380c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:11.723905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c0d38bab-d8a8-41d5-9bc4-a84f6269380c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:11.725364 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9050654a-1854-460a-9a3e-3c8f9cbafd40 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:11.725810 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9050654a-1854-460a-9a3e-3c8f9cbafd40 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:11.726566 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9050654a-1854-460a-9a3e-3c8f9cbafd40 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:11.727033 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9050654a-1854-460a-9a3e-3c8f9cbafd40 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:11.794891 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c0d38bab-d8a8-41d5-9bc4-a84f6269380c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:11.802459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c0d38bab-d8a8-41d5-9bc4-a84f6269380c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1311 microversion: 2.1 time: 0.091370 Jun 15 15:59:11.803055 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 431/851] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:11 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:11.873824 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9050654a-1854-460a-9a3e-3c8f9cbafd40 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:11.881509 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9050654a-1854-460a-9a3e-3c8f9cbafd40 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1502 microversion: 2.1 time: 0.166693 Jun 15 15:59:11.882077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 421/852] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:11 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:59:12.546362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dab15c19-5dd0-44f2-9464-4f8b3220e37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:12.547000 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-dab15c19-5dd0-44f2-9464-4f8b3220e37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:12.553506 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dab15c19-5dd0-44f2-9464-4f8b3220e37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:12.554161 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dab15c19-5dd0-44f2-9464-4f8b3220e37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:12.555017 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dab15c19-5dd0-44f2-9464-4f8b3220e37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:12.555644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dab15c19-5dd0-44f2-9464-4f8b3220e37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:12.773946 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dab15c19-5dd0-44f2-9464-4f8b3220e37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:12.783126 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dab15c19-5dd0-44f2-9464-4f8b3220e37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:12.784881 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dab15c19-5dd0-44f2-9464-4f8b3220e37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:12.786034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-dab15c19-5dd0-44f2-9464-4f8b3220e37b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.244294 Jun 15 15:59:12.786585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 432/853] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:12 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:12.820261 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9104b2d4-ed9d-405f-bf56-8dcff6667221 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:12.820881 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9104b2d4-ed9d-405f-bf56-8dcff6667221 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:12.828009 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9104b2d4-ed9d-405f-bf56-8dcff6667221 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:12.828458 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9104b2d4-ed9d-405f-bf56-8dcff6667221 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:12.829219 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9104b2d4-ed9d-405f-bf56-8dcff6667221 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:12.829659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9104b2d4-ed9d-405f-bf56-8dcff6667221 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:12.898676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d9db9b09-9fbb-4575-a566-11f1e886bd69 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:12.899756 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d9db9b09-9fbb-4575-a566-11f1e886bd69 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:12.918347 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d9db9b09-9fbb-4575-a566-11f1e886bd69 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:12.918755 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d9db9b09-9fbb-4575-a566-11f1e886bd69 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:12.919548 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d9db9b09-9fbb-4575-a566-11f1e886bd69 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:12.919980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d9db9b09-9fbb-4575-a566-11f1e886bd69 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:13.075352 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9104b2d4-ed9d-405f-bf56-8dcff6667221 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:13.084374 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9104b2d4-ed9d-405f-bf56-8dcff6667221 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1367 microversion: 2.1 time: 0.268332 Jun 15 15:59:13.085276 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 422/854] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:12 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:13.209348 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d9db9b09-9fbb-4575-a566-11f1e886bd69 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:13.217409 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d9db9b09-9fbb-4575-a566-11f1e886bd69 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 200 len: 1502 microversion: 2.1 time: 0.322742 Jun 15 15:59:13.226627 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 433/855] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:12 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 1502 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:13.336565 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-2764695a-b40f-4b1d-a170-f80de5a5e78a req-68e76e95-7a0d-4032-8892-0e7618df5a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eef58215-9aca-49c3-a96f-2554bc62676c", "name": "network-vif-deleted", "tag": "828204a4-1d3a-467f-825b-56b41c899865"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:13.345474 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-2764695a-b40f-4b1d-a170-f80de5a5e78a req-68e76e95-7a0d-4032-8892-0e7618df5a2b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:13.345998 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-2764695a-b40f-4b1d-a170-f80de5a5e78a req-68e76e95-7a0d-4032-8892-0e7618df5a2b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:13.358040 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-2764695a-b40f-4b1d-a170-f80de5a5e78a req-68e76e95-7a0d-4032-8892-0e7618df5a2b service nova] Creating event network-vif-deleted:828204a4-1d3a-467f-825b-56b41c899865 for instance eef58215-9aca-49c3-a96f-2554bc62676c on hv-cinder-84599 Jun 15 15:59:13.362964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-2764695a-b40f-4b1d-a170-f80de5a5e78a req-68e76e95-7a0d-4032-8892-0e7618df5a2b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030106 Jun 15 15:59:13.363688 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 423/856] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:13.661781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-6191c4f9-9220-44a3-971b-aa411066f7a9 req-08211738-df64-49c7-b32e-346882a795dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd8dffe-820f-45e3-925c-881780df5c8d", "tag": "7f8a4730-b2cf-4a02-87a9-0dd60103021a"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:13.669791 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-6191c4f9-9220-44a3-971b-aa411066f7a9 req-08211738-df64-49c7-b32e-346882a795dc service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:13.670577 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-6191c4f9-9220-44a3-971b-aa411066f7a9 req-08211738-df64-49c7-b32e-346882a795dc service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:13.683632 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-6191c4f9-9220-44a3-971b-aa411066f7a9 req-08211738-df64-49c7-b32e-346882a795dc service nova] Creating event network-changed:7f8a4730-b2cf-4a02-87a9-0dd60103021a for instance acd8dffe-820f-45e3-925c-881780df5c8d on hv-cinder-84599 Jun 15 15:59:13.689221 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-6191c4f9-9220-44a3-971b-aa411066f7a9 req-08211738-df64-49c7-b32e-346882a795dc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030726 Jun 15 15:59:13.690150 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 434/857] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:13.804809 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-856569eb-47fd-4685-af6d-406c2f61d2e3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:13.805590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-856569eb-47fd-4685-af6d-406c2f61d2e3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:13.808727 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:13.812330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-856569eb-47fd-4685-af6d-406c2f61d2e3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:13.812778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-856569eb-47fd-4685-af6d-406c2f61d2e3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:13.813539 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-856569eb-47fd-4685-af6d-406c2f61d2e3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:13.814272 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-856569eb-47fd-4685-af6d-406c2f61d2e3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:13.960024 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-856569eb-47fd-4685-af6d-406c2f61d2e3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:13.968810 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-856569eb-47fd-4685-af6d-406c2f61d2e3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:13.970370 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-856569eb-47fd-4685-af6d-406c2f61d2e3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:13.971586 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-856569eb-47fd-4685-af6d-406c2f61d2e3 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.171044 Jun 15 15:59:13.972512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 424/858] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:13 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:14.102027 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-146dc028-1b3c-495c-97d1-ce794a7c8b35 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:14.102743 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-146dc028-1b3c-495c-97d1-ce794a7c8b35 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:14.110318 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-146dc028-1b3c-495c-97d1-ce794a7c8b35 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:14.110791 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-146dc028-1b3c-495c-97d1-ce794a7c8b35 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:14.111553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-146dc028-1b3c-495c-97d1-ce794a7c8b35 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:14.112264 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-146dc028-1b3c-495c-97d1-ce794a7c8b35 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:14.234527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4c4c00db-ddc1-4d02-895c-e46bfe492d99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:14.235327 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4c4c00db-ddc1-4d02-895c-e46bfe492d99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: eef58215-9aca-49c3-a96f-2554bc62676c] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:14.241480 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4c4c00db-ddc1-4d02-895c-e46bfe492d99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:14.241930 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4c4c00db-ddc1-4d02-895c-e46bfe492d99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:14.242781 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4c4c00db-ddc1-4d02-895c-e46bfe492d99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:14.243219 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4c4c00db-ddc1-4d02-895c-e46bfe492d99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:14.257262 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-4c4c00db-ddc1-4d02-895c-e46bfe492d99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] HTTP exception thrown: Instance eef58215-9aca-49c3-a96f-2554bc62676c could not be found. Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4c4c00db-ddc1-4d02-895c-e46bfe492d99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Request method failure captured: Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c HTTP/1.1 Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgG8AAmfT5o26p_vMwmaOt0mFHKGN99gy0MUfG4odRGdHg0dZMZLUQVK8dtF58YTe4SVT-ax370hR-2mlb-aq_skKc8sCgVADmCvmtehOF_09-WXumxfF4VJSP8JnN0ExlhPP2L8NT4UlLlFzs6qZlh0BPVZbBpJt9i0bAfWtyTsjD0 Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 4babb3ea9898402ba7898395d59b4beb Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-VolumesActionsTest-1375842701 Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:59:14.258873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4babb3ea9898402ba7898395d59b4beb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4babb3ea9898402ba7898395d59b4beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4babb3ea9898402ba7898395d59b4beb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4babb3ea9898402ba7898395d59b4beb", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-VolumesActionsTest-1375842701 Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 4babb3ea9898402ba7898395d59b4beb Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-VolumesActionsTest-1375842701 Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-VolumesActionsTest-1375842701-project Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 00609e23ec8d4eadb9709b4e497810e3 Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-VolumesActionsTest-1375842701-project Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance eef58215-9aca-49c3-a96f-2554bc62676c could not be found. Jun 15 15:59:14.260448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'eef58215-9aca-49c3-a96f-2554bc62676c'} Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eef58215-9aca-49c3-a96f-2554bc62676c could not be found. Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:59:14.265093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eef58215-9aca-49c3-a96f-2554bc62676c could not be found. Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eef58215-9aca-49c3-a96f-2554bc62676c could not be found. Jun 15 15:59:14.266572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:59:14.267886 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4c4c00db-ddc1-4d02-895c-e46bfe492d99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Returning 404 to user: Instance eef58215-9aca-49c3-a96f-2554bc62676c could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:59:14.267886 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4c4c00db-ddc1-4d02-895c-e46bfe492d99 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c" status: 404 len: 111 microversion: 2.1 time: 0.030484 Jun 15 15:59:14.267886 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 425/859] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:14 2022] GET /compute/v2.1/servers/eef58215-9aca-49c3-a96f-2554bc62676c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:59:14.314497 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1854402542", "imageRef": "8b0b9c6c-acfd-4c45-a47f-399f6b59189d", "flavorRef": "452", "networks": [{"uuid": "8fd801ac-5710-4516-974f-f1de1a231e33"}]}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:14.319036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-146dc028-1b3c-495c-97d1-ce794a7c8b35 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:14.328532 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-146dc028-1b3c-495c-97d1-ce794a7c8b35 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1367 microversion: 2.1 time: 0.230612 Jun 15 15:59:14.329417 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 435/860] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:14 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:14.368090 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] validate_networks() for [('8fd801ac-5710-4516-974f-f1de1a231e33', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 15:59:14.888073 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 15:59:14.888539 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 15:59:14.889012 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 15:59:14.889418 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 15:59:14.889821 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 15:59:14.898594 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:14.899065 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:14.899860 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:14.900293 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:14.918195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Getting quotas for project 4babb3ea9898402ba7898395d59b4beb. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 15:59:14.922223 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Getting quotas for user 00609e23ec8d4eadb9709b4e497810e3 and project 4babb3ea9898402ba7898395d59b4beb. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 15:59:14.933084 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 15:59:14.935380 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b0b9c6c-acfd-4c45-a47f-399f6b59189d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 15:59:14.980625 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b4383f57-50e6-4dde-919b-d295968929e3 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669097 Jun 15 15:59:14.986380 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 426/861] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 15:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 15 15:59:14.989355 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3352f3eb-c03a-410e-89bf-ed224311e4c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:14.989965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3352f3eb-c03a-410e-89bf-ed224311e4c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:14.992175 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0518a527-98ea-440f-bbdb-7520aa07a61c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:14.992789 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0518a527-98ea-440f-bbdb-7520aa07a61c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:15.018193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3352f3eb-c03a-410e-89bf-ed224311e4c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:15.031386 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3352f3eb-c03a-410e-89bf-ed224311e4c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:15.033207 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3352f3eb-c03a-410e-89bf-ed224311e4c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:15.033915 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3352f3eb-c03a-410e-89bf-ed224311e4c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:15.052082 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0518a527-98ea-440f-bbdb-7520aa07a61c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:15.058964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0518a527-98ea-440f-bbdb-7520aa07a61c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1214 microversion: 2.1 time: 0.071500 Jun 15 15:59:15.060047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 427/862] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:14 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:15.177712 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3352f3eb-c03a-410e-89bf-ed224311e4c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:15.186591 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3352f3eb-c03a-410e-89bf-ed224311e4c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:15.188211 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3352f3eb-c03a-410e-89bf-ed224311e4c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:15.189467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3352f3eb-c03a-410e-89bf-ed224311e4c5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.204018 Jun 15 15:59:15.190423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 436/863] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:14 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 15:59:15.347001 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c78d6972-9f44-42b8-876f-878a55c2f215 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:15.347593 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c78d6972-9f44-42b8-876f-878a55c2f215 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:15.354556 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c78d6972-9f44-42b8-876f-878a55c2f215 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:15.354934 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c78d6972-9f44-42b8-876f-878a55c2f215 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:15.355705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c78d6972-9f44-42b8-876f-878a55c2f215 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:15.356146 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c78d6972-9f44-42b8-876f-878a55c2f215 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:15.483185 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c78d6972-9f44-42b8-876f-878a55c2f215 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:15.490639 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c78d6972-9f44-42b8-876f-878a55c2f215 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1367 microversion: 2.1 time: 0.148262 Jun 15 15:59:15.491234 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 428/864] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:15 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:16.077033 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dba63c6f-35a7-4bf9-9e67-527a404d7127 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:16.077671 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-dba63c6f-35a7-4bf9-9e67-527a404d7127 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:16.083833 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dba63c6f-35a7-4bf9-9e67-527a404d7127 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:16.084283 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dba63c6f-35a7-4bf9-9e67-527a404d7127 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:16.085051 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dba63c6f-35a7-4bf9-9e67-527a404d7127 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:16.085467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dba63c6f-35a7-4bf9-9e67-527a404d7127 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:16.144850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dba63c6f-35a7-4bf9-9e67-527a404d7127 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:16.152829 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-dba63c6f-35a7-4bf9-9e67-527a404d7127 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1218 microversion: 2.1 time: 0.080183 Jun 15 15:59:16.153391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 437/865] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:16 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:16.207787 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-cb13954f-4e6a-4e16-8735-95039c7bfec1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:16.208394 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-cb13954f-4e6a-4e16-8735-95039c7bfec1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:16.214988 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cb13954f-4e6a-4e16-8735-95039c7bfec1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:16.215452 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cb13954f-4e6a-4e16-8735-95039c7bfec1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:16.216210 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cb13954f-4e6a-4e16-8735-95039c7bfec1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:16.216702 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cb13954f-4e6a-4e16-8735-95039c7bfec1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:16.346114 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-cb13954f-4e6a-4e16-8735-95039c7bfec1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:16.353982 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-cb13954f-4e6a-4e16-8735-95039c7bfec1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:16.355536 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-cb13954f-4e6a-4e16-8735-95039c7bfec1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:16.356690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-cb13954f-4e6a-4e16-8735-95039c7bfec1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.152826 Jun 15 15:59:16.357249 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 429/866] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:16 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:16.507801 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d7e8dea0-a8ca-4541-a442-78e6c0f00569 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:16.508410 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d7e8dea0-a8ca-4541-a442-78e6c0f00569 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:16.515283 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d7e8dea0-a8ca-4541-a442-78e6c0f00569 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:16.515763 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d7e8dea0-a8ca-4541-a442-78e6c0f00569 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:16.516533 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d7e8dea0-a8ca-4541-a442-78e6c0f00569 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:16.516970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d7e8dea0-a8ca-4541-a442-78e6c0f00569 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:16.646489 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d7e8dea0-a8ca-4541-a442-78e6c0f00569 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:16.653850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d7e8dea0-a8ca-4541-a442-78e6c0f00569 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1367 microversion: 2.1 time: 0.149960 Jun 15 15:59:16.654408 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 438/867] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:16 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:17.170158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f2c789d4-123a-4cd7-ba86-eab8165ee661 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:17.170786 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f2c789d4-123a-4cd7-ba86-eab8165ee661 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:17.176994 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f2c789d4-123a-4cd7-ba86-eab8165ee661 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:17.177355 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f2c789d4-123a-4cd7-ba86-eab8165ee661 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:17.178113 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f2c789d4-123a-4cd7-ba86-eab8165ee661 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:17.178545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f2c789d4-123a-4cd7-ba86-eab8165ee661 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:17.237665 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f2c789d4-123a-4cd7-ba86-eab8165ee661 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:17.245132 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f2c789d4-123a-4cd7-ba86-eab8165ee661 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1218 microversion: 2.1 time: 0.079402 Jun 15 15:59:17.245695 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 430/868] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:17 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:17.375208 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0971628b-7349-43c8-bb6f-87b1a2f242d6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:17.375840 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0971628b-7349-43c8-bb6f-87b1a2f242d6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:17.382246 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0971628b-7349-43c8-bb6f-87b1a2f242d6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:17.382694 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0971628b-7349-43c8-bb6f-87b1a2f242d6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:17.383474 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0971628b-7349-43c8-bb6f-87b1a2f242d6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:17.383902 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0971628b-7349-43c8-bb6f-87b1a2f242d6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:17.513546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0971628b-7349-43c8-bb6f-87b1a2f242d6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:17.521364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0971628b-7349-43c8-bb6f-87b1a2f242d6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:17.522862 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0971628b-7349-43c8-bb6f-87b1a2f242d6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:17.523990 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0971628b-7349-43c8-bb6f-87b1a2f242d6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.153351 Jun 15 15:59:17.524541 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 439/869] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:17 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:17.671399 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-15126c82-a7c5-4d96-96d9-c6f4fb046ca0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:17.672012 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-15126c82-a7c5-4d96-96d9-c6f4fb046ca0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:17.678170 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-15126c82-a7c5-4d96-96d9-c6f4fb046ca0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:17.678514 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-15126c82-a7c5-4d96-96d9-c6f4fb046ca0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:17.679308 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-15126c82-a7c5-4d96-96d9-c6f4fb046ca0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:17.679748 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-15126c82-a7c5-4d96-96d9-c6f4fb046ca0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:17.804770 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-15126c82-a7c5-4d96-96d9-c6f4fb046ca0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:17.808259 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:17.813187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-15126c82-a7c5-4d96-96d9-c6f4fb046ca0 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1367 microversion: 2.1 time: 0.146314 Jun 15 15:59:17.813758 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 431/870] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:17 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:18.262938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c9faf466-d42c-4fe8-906b-748bc2225988 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:18.263548 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c9faf466-d42c-4fe8-906b-748bc2225988 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:18.269606 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9faf466-d42c-4fe8-906b-748bc2225988 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:18.270052 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9faf466-d42c-4fe8-906b-748bc2225988 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:18.270854 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9faf466-d42c-4fe8-906b-748bc2225988 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:18.271288 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9faf466-d42c-4fe8-906b-748bc2225988 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:18.332185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c9faf466-d42c-4fe8-906b-748bc2225988 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:18.340127 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c9faf466-d42c-4fe8-906b-748bc2225988 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1266 microversion: 2.1 time: 0.081983 Jun 15 15:59:18.340681 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 440/871] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:18 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:18.542678 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-21a6b26a-f7c2-46d2-b410-0d92c37a56e6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:18.543567 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-21a6b26a-f7c2-46d2-b410-0d92c37a56e6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:18.551811 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21a6b26a-f7c2-46d2-b410-0d92c37a56e6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:18.552254 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21a6b26a-f7c2-46d2-b410-0d92c37a56e6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:18.553022 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21a6b26a-f7c2-46d2-b410-0d92c37a56e6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:18.553455 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21a6b26a-f7c2-46d2-b410-0d92c37a56e6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:18.782597 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-21a6b26a-f7c2-46d2-b410-0d92c37a56e6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:18.790924 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-21a6b26a-f7c2-46d2-b410-0d92c37a56e6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:18.792975 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-21a6b26a-f7c2-46d2-b410-0d92c37a56e6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:18.794143 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-21a6b26a-f7c2-46d2-b410-0d92c37a56e6 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.255894 Jun 15 15:59:18.794696 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 432/872] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:18 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:18.829302 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-286d0e25-d8bb-4161-8720-4ac46aa77a47 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:18.829955 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-286d0e25-d8bb-4161-8720-4ac46aa77a47 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:18.836504 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-286d0e25-d8bb-4161-8720-4ac46aa77a47 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:18.836949 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-286d0e25-d8bb-4161-8720-4ac46aa77a47 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:18.837705 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-286d0e25-d8bb-4161-8720-4ac46aa77a47 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:18.838135 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-286d0e25-d8bb-4161-8720-4ac46aa77a47 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:19.268286 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-286d0e25-d8bb-4161-8720-4ac46aa77a47 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:19.276941 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-286d0e25-d8bb-4161-8720-4ac46aa77a47 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1367 microversion: 2.1 time: 0.451319 Jun 15 15:59:19.277517 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 441/873] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:18 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1367 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:19.356929 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-73e2e241-cbc1-4dd1-8555-f684a3b7b24d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:19.357946 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-73e2e241-cbc1-4dd1-8555-f684a3b7b24d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:19.364149 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-73e2e241-cbc1-4dd1-8555-f684a3b7b24d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:19.364872 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-73e2e241-cbc1-4dd1-8555-f684a3b7b24d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:19.365929 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-73e2e241-cbc1-4dd1-8555-f684a3b7b24d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:19.366551 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-73e2e241-cbc1-4dd1-8555-f684a3b7b24d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:19.450036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-73e2e241-cbc1-4dd1-8555-f684a3b7b24d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:19.457437 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-73e2e241-cbc1-4dd1-8555-f684a3b7b24d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1272 microversion: 2.1 time: 0.104324 Jun 15 15:59:19.457996 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 433/874] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:19 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:19.812671 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dbb5fa2e-b143-41a2-868b-0e8fbf3d1208 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:19.813275 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-dbb5fa2e-b143-41a2-868b-0e8fbf3d1208 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:19.819428 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbb5fa2e-b143-41a2-868b-0e8fbf3d1208 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:19.819878 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbb5fa2e-b143-41a2-868b-0e8fbf3d1208 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:19.820643 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbb5fa2e-b143-41a2-868b-0e8fbf3d1208 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:19.821086 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dbb5fa2e-b143-41a2-868b-0e8fbf3d1208 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:20.068316 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dbb5fa2e-b143-41a2-868b-0e8fbf3d1208 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:20.076239 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dbb5fa2e-b143-41a2-868b-0e8fbf3d1208 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:20.077838 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dbb5fa2e-b143-41a2-868b-0e8fbf3d1208 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:20.079199 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-dbb5fa2e-b143-41a2-868b-0e8fbf3d1208 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.270953 Jun 15 15:59:20.079749 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 442/875] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:19 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:20.293842 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-14c2c50d-8f46-48b5-99e6-7cae83247a94 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:20.294503 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-14c2c50d-8f46-48b5-99e6-7cae83247a94 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:20.301303 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-14c2c50d-8f46-48b5-99e6-7cae83247a94 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:20.301970 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-14c2c50d-8f46-48b5-99e6-7cae83247a94 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:20.302769 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-14c2c50d-8f46-48b5-99e6-7cae83247a94 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:20.303238 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-14c2c50d-8f46-48b5-99e6-7cae83247a94 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:20.473388 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-78eab9ef-1882-47bf-a786-8afca9ce27dc tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:20.473896 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-78eab9ef-1882-47bf-a786-8afca9ce27dc tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:20.480111 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78eab9ef-1882-47bf-a786-8afca9ce27dc tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:20.480554 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78eab9ef-1882-47bf-a786-8afca9ce27dc tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:20.481315 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78eab9ef-1882-47bf-a786-8afca9ce27dc tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:20.481744 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-78eab9ef-1882-47bf-a786-8afca9ce27dc tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:20.485883 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:20.489644 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-14c2c50d-8f46-48b5-99e6-7cae83247a94 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:20.497292 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-14c2c50d-8f46-48b5-99e6-7cae83247a94 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1367 microversion: 2.1 time: 0.207560 Jun 15 15:59:20.497899 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 434/876] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:20 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:20.598618 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-a9045fda-a4b8-4641-9dd1-4705df523221 req-c1af2f48-c882-444a-89dd-597ca32e1f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3786843-5891-48e9-98a3-7f6dcbbd58b6", "tag": "97c547d4-a8f9-45aa-bfcd-ee85032bfc25"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:20.609265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-a9045fda-a4b8-4641-9dd1-4705df523221 req-c1af2f48-c882-444a-89dd-597ca32e1f7b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:20.610125 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-a9045fda-a4b8-4641-9dd1-4705df523221 req-c1af2f48-c882-444a-89dd-597ca32e1f7b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:20.621858 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-a9045fda-a4b8-4641-9dd1-4705df523221 req-c1af2f48-c882-444a-89dd-597ca32e1f7b service nova] Creating event network-changed:97c547d4-a8f9-45aa-bfcd-ee85032bfc25 for instance f3786843-5891-48e9-98a3-7f6dcbbd58b6 on hv-cinder-84599 Jun 15 15:59:20.627241 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-a9045fda-a4b8-4641-9dd1-4705df523221 req-c1af2f48-c882-444a-89dd-597ca32e1f7b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034404 Jun 15 15:59:20.628183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 435/877] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:59:20.691898 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-78eab9ef-1882-47bf-a786-8afca9ce27dc tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:20.701401 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-78eab9ef-1882-47bf-a786-8afca9ce27dc tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1314 microversion: 2.1 time: 0.231787 Jun 15 15:59:20.702137 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 443/878] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:20 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:59:20.843658 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-263d9cfd-383b-4a04-88d7-94c98334cf41 req-fa4c3da4-68b7-45b0-b47f-db28c7042013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd8dffe-820f-45e3-925c-881780df5c8d", "name": "network-vif-plugged", "status": "completed", "tag": "7f8a4730-b2cf-4a02-87a9-0dd60103021a"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:20.853483 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-263d9cfd-383b-4a04-88d7-94c98334cf41 req-fa4c3da4-68b7-45b0-b47f-db28c7042013 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:20.854021 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-263d9cfd-383b-4a04-88d7-94c98334cf41 req-fa4c3da4-68b7-45b0-b47f-db28c7042013 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:20.866373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-263d9cfd-383b-4a04-88d7-94c98334cf41 req-fa4c3da4-68b7-45b0-b47f-db28c7042013 service nova] Creating event network-vif-plugged:7f8a4730-b2cf-4a02-87a9-0dd60103021a for instance acd8dffe-820f-45e3-925c-881780df5c8d on hv-cinder-84599 Jun 15 15:59:20.871748 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-263d9cfd-383b-4a04-88d7-94c98334cf41 req-fa4c3da4-68b7-45b0-b47f-db28c7042013 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032764 Jun 15 15:59:20.872344 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 436/879] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:21.097446 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b2f71e92-9070-4da2-8c96-3acf99d64db5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:21.098052 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b2f71e92-9070-4da2-8c96-3acf99d64db5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:21.104488 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2f71e92-9070-4da2-8c96-3acf99d64db5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:21.105676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2f71e92-9070-4da2-8c96-3acf99d64db5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:21.106446 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2f71e92-9070-4da2-8c96-3acf99d64db5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:21.107149 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2f71e92-9070-4da2-8c96-3acf99d64db5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:21.265785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b2f71e92-9070-4da2-8c96-3acf99d64db5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:21.274262 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b2f71e92-9070-4da2-8c96-3acf99d64db5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:21.275836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b2f71e92-9070-4da2-8c96-3acf99d64db5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:21.276930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b2f71e92-9070-4da2-8c96-3acf99d64db5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.183392 Jun 15 15:59:21.277479 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 444/880] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:21 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:21.513806 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1edd49d9-e580-4506-b8be-f5a51093cbd3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:21.514513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1edd49d9-e580-4506-b8be-f5a51093cbd3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:21.521317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1edd49d9-e580-4506-b8be-f5a51093cbd3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:21.521771 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1edd49d9-e580-4506-b8be-f5a51093cbd3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:21.522535 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1edd49d9-e580-4506-b8be-f5a51093cbd3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:21.523000 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1edd49d9-e580-4506-b8be-f5a51093cbd3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:21.653774 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1edd49d9-e580-4506-b8be-f5a51093cbd3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:21.661357 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1edd49d9-e580-4506-b8be-f5a51093cbd3 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1367 microversion: 2.1 time: 0.151767 Jun 15 15:59:21.661913 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 437/881] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:21 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:21.717973 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-eb9ed49e-ace8-4e9b-af20-2f9ed432005d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:21.718582 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-eb9ed49e-ace8-4e9b-af20-2f9ed432005d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:21.724587 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eb9ed49e-ace8-4e9b-af20-2f9ed432005d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:21.725039 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eb9ed49e-ace8-4e9b-af20-2f9ed432005d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:21.725797 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eb9ed49e-ace8-4e9b-af20-2f9ed432005d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:21.726229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eb9ed49e-ace8-4e9b-af20-2f9ed432005d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:21.856521 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-eb9ed49e-ace8-4e9b-af20-2f9ed432005d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:21.863896 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-eb9ed49e-ace8-4e9b-af20-2f9ed432005d tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1314 microversion: 2.1 time: 0.150273 Jun 15 15:59:21.864456 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 445/882] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:21 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:22.295526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-761013b2-4221-445d-82ab-759e57c3a1b5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:22.296127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-761013b2-4221-445d-82ab-759e57c3a1b5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:22.302073 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-761013b2-4221-445d-82ab-759e57c3a1b5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:22.302515 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-761013b2-4221-445d-82ab-759e57c3a1b5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:22.303293 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-761013b2-4221-445d-82ab-759e57c3a1b5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:22.303720 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-761013b2-4221-445d-82ab-759e57c3a1b5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:22.433732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-761013b2-4221-445d-82ab-759e57c3a1b5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:22.441758 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-761013b2-4221-445d-82ab-759e57c3a1b5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:22.443304 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-761013b2-4221-445d-82ab-759e57c3a1b5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:22.444531 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-761013b2-4221-445d-82ab-759e57c3a1b5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1745 microversion: 2.20 time: 0.152869 Jun 15 15:59:22.445095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 438/883] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:22 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:22.678840 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cc42bbc7-2385-43be-9c93-e9061f428ea7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:22.679455 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-cc42bbc7-2385-43be-9c93-e9061f428ea7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:22.685799 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cc42bbc7-2385-43be-9c93-e9061f428ea7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:22.686248 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cc42bbc7-2385-43be-9c93-e9061f428ea7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:22.687031 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cc42bbc7-2385-43be-9c93-e9061f428ea7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:22.687465 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cc42bbc7-2385-43be-9c93-e9061f428ea7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:22.815365 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cc42bbc7-2385-43be-9c93-e9061f428ea7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:22.822781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-cc42bbc7-2385-43be-9c93-e9061f428ea7 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1367 microversion: 2.1 time: 0.147731 Jun 15 15:59:22.823774 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 446/884] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:22 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:22.879997 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-622805c7-44a7-43e9-a046-355e1fb85dec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:22.880616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-622805c7-44a7-43e9-a046-355e1fb85dec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:22.887799 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-622805c7-44a7-43e9-a046-355e1fb85dec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:22.888249 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-622805c7-44a7-43e9-a046-355e1fb85dec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:22.889013 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-622805c7-44a7-43e9-a046-355e1fb85dec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:22.889445 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-622805c7-44a7-43e9-a046-355e1fb85dec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:23.018412 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-622805c7-44a7-43e9-a046-355e1fb85dec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:23.025898 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-622805c7-44a7-43e9-a046-355e1fb85dec tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1314 microversion: 2.1 time: 0.149976 Jun 15 15:59:23.026468 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 439/885] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:22 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:23.462900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-331851a6-2320-490e-98ac-19c7e8261b8c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:23.463509 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-331851a6-2320-490e-98ac-19c7e8261b8c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:23.469530 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-331851a6-2320-490e-98ac-19c7e8261b8c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:23.469974 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-331851a6-2320-490e-98ac-19c7e8261b8c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:23.470750 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-331851a6-2320-490e-98ac-19c7e8261b8c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:23.471186 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-331851a6-2320-490e-98ac-19c7e8261b8c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:23.598120 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-331851a6-2320-490e-98ac-19c7e8261b8c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:23.607329 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-331851a6-2320-490e-98ac-19c7e8261b8c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:23.609884 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-331851a6-2320-490e-98ac-19c7e8261b8c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:23.611652 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-331851a6-2320-490e-98ac-19c7e8261b8c tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1745 microversion: 2.20 time: 0.152652 Jun 15 15:59:23.612362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 447/886] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:23 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:23.840444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a4181d8a-a174-41c9-a455-f1a7c8a29d6d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:23.840962 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a4181d8a-a174-41c9-a455-f1a7c8a29d6d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:23.847188 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4181d8a-a174-41c9-a455-f1a7c8a29d6d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:23.847641 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4181d8a-a174-41c9-a455-f1a7c8a29d6d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:23.848405 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4181d8a-a174-41c9-a455-f1a7c8a29d6d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:23.848843 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a4181d8a-a174-41c9-a455-f1a7c8a29d6d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:23.974154 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a4181d8a-a174-41c9-a455-f1a7c8a29d6d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:23.982289 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a4181d8a-a174-41c9-a455-f1a7c8a29d6d tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1367 microversion: 2.1 time: 0.146317 Jun 15 15:59:23.982886 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 440/887] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:23 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:24.042502 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3f92d677-2c67-496b-b783-3ae005e0e25c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:24.043152 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3f92d677-2c67-496b-b783-3ae005e0e25c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:24.049490 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f92d677-2c67-496b-b783-3ae005e0e25c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:24.049928 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f92d677-2c67-496b-b783-3ae005e0e25c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:24.050677 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f92d677-2c67-496b-b783-3ae005e0e25c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:24.051129 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f92d677-2c67-496b-b783-3ae005e0e25c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:24.180156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3f92d677-2c67-496b-b783-3ae005e0e25c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:24.187603 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3f92d677-2c67-496b-b783-3ae005e0e25c tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1314 microversion: 2.1 time: 0.148968 Jun 15 15:59:24.188162 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 448/888] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:24 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:24.631195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e3e9b4fd-a5d3-4f01-9891-30b90ef54d7f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:24.631806 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e3e9b4fd-a5d3-4f01-9891-30b90ef54d7f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:24.638414 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e3e9b4fd-a5d3-4f01-9891-30b90ef54d7f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:24.638896 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e3e9b4fd-a5d3-4f01-9891-30b90ef54d7f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:24.639668 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e3e9b4fd-a5d3-4f01-9891-30b90ef54d7f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:24.640112 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e3e9b4fd-a5d3-4f01-9891-30b90ef54d7f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:24.771870 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e3e9b4fd-a5d3-4f01-9891-30b90ef54d7f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:24.779770 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e3e9b4fd-a5d3-4f01-9891-30b90ef54d7f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:24.781287 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e3e9b4fd-a5d3-4f01-9891-30b90ef54d7f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:24.782448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e3e9b4fd-a5d3-4f01-9891-30b90ef54d7f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1745 microversion: 2.20 time: 0.155224 Jun 15 15:59:24.783049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 441/889] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:24 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:24.868338 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-8a45e625-708c-4856-9a26-8aebc9636b76 req-7b6a962d-93cd-4ae1-a76d-8f4bc3c683d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c4bb33d-2d9f-4620-9e94-f28e12cd604f", "name": "network-vif-plugged", "status": "completed", "tag": "6153ea23-abc5-46cb-96ff-6597e6888d85"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:24.872550 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:24.878149 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-8a45e625-708c-4856-9a26-8aebc9636b76 req-7b6a962d-93cd-4ae1-a76d-8f4bc3c683d4 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:24.878609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-8a45e625-708c-4856-9a26-8aebc9636b76 req-7b6a962d-93cd-4ae1-a76d-8f4bc3c683d4 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:24.890177 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-8a45e625-708c-4856-9a26-8aebc9636b76 req-7b6a962d-93cd-4ae1-a76d-8f4bc3c683d4 service nova] Creating event network-vif-plugged:6153ea23-abc5-46cb-96ff-6597e6888d85 for instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f on hv-cinder-84599 Jun 15 15:59:24.895243 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-8a45e625-708c-4856-9a26-8aebc9636b76 req-7b6a962d-93cd-4ae1-a76d-8f4bc3c683d4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030486 Jun 15 15:59:24.895803 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 449/890] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:59:24.999665 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6306f806-de64-4ddb-a5f0-6bd120b10e39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:25.000406 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6306f806-de64-4ddb-a5f0-6bd120b10e39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:25.002823 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=4 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:25.008478 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6306f806-de64-4ddb-a5f0-6bd120b10e39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:25.008945 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6306f806-de64-4ddb-a5f0-6bd120b10e39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:25.009743 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6306f806-de64-4ddb-a5f0-6bd120b10e39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:25.010179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6306f806-de64-4ddb-a5f0-6bd120b10e39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:25.059065 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=20 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:25.143281 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6306f806-de64-4ddb-a5f0-6bd120b10e39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:25.150659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6306f806-de64-4ddb-a5f0-6bd120b10e39 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1367 microversion: 2.1 time: 0.155414 Jun 15 15:59:25.151250 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 442/891] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:24 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:25.205650 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e116c351-d0f0-4f9d-b307-5e5f31a61c91 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:25.206359 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e116c351-d0f0-4f9d-b307-5e5f31a61c91 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:25.213043 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e116c351-d0f0-4f9d-b307-5e5f31a61c91 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:25.213491 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e116c351-d0f0-4f9d-b307-5e5f31a61c91 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:25.214273 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e116c351-d0f0-4f9d-b307-5e5f31a61c91 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:25.214706 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e116c351-d0f0-4f9d-b307-5e5f31a61c91 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:25.346246 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e116c351-d0f0-4f9d-b307-5e5f31a61c91 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:25.353723 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e116c351-d0f0-4f9d-b307-5e5f31a61c91 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1314 microversion: 2.1 time: 0.152655 Jun 15 15:59:25.354287 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 450/892] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:25 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:25.801335 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d007d6ff-5bd8-4f09-b799-07581283da4a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:25.801867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d007d6ff-5bd8-4f09-b799-07581283da4a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:25.808964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d007d6ff-5bd8-4f09-b799-07581283da4a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:25.809663 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d007d6ff-5bd8-4f09-b799-07581283da4a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:25.810442 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d007d6ff-5bd8-4f09-b799-07581283da4a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:25.810910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d007d6ff-5bd8-4f09-b799-07581283da4a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:25.937761 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d007d6ff-5bd8-4f09-b799-07581283da4a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:25.945550 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d007d6ff-5bd8-4f09-b799-07581283da4a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:25.947075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d007d6ff-5bd8-4f09-b799-07581283da4a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:25.948222 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d007d6ff-5bd8-4f09-b799-07581283da4a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1745 microversion: 2.20 time: 0.150956 Jun 15 15:59:25.948748 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 443/893] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:25 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:26.169334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0e10aca9-c13a-4233-b27f-0f01b646b8ce tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:26.169943 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0e10aca9-c13a-4233-b27f-0f01b646b8ce tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:26.176078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e10aca9-c13a-4233-b27f-0f01b646b8ce tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:26.176515 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e10aca9-c13a-4233-b27f-0f01b646b8ce tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:26.177257 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e10aca9-c13a-4233-b27f-0f01b646b8ce tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:26.177682 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e10aca9-c13a-4233-b27f-0f01b646b8ce tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:26.305856 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0e10aca9-c13a-4233-b27f-0f01b646b8ce tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:26.313804 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0e10aca9-c13a-4233-b27f-0f01b646b8ce tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1557 microversion: 2.1 time: 0.148338 Jun 15 15:59:26.314357 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 451/894] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:26 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:26.330717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8d3671da-5c84-471f-865e-05b3e5746fde tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:26.331229 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-8d3671da-5c84-471f-865e-05b3e5746fde tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:26.337697 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8d3671da-5c84-471f-865e-05b3e5746fde tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:26.338140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8d3671da-5c84-471f-865e-05b3e5746fde tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:26.339024 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8d3671da-5c84-471f-865e-05b3e5746fde tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:26.339459 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8d3671da-5c84-471f-865e-05b3e5746fde tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:26.370913 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d20a3caa-358d-454d-b67c-02606f7d7a0a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:26.371522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d20a3caa-358d-454d-b67c-02606f7d7a0a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:26.378255 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d20a3caa-358d-454d-b67c-02606f7d7a0a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:26.378851 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d20a3caa-358d-454d-b67c-02606f7d7a0a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:26.379857 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d20a3caa-358d-454d-b67c-02606f7d7a0a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:26.380594 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d20a3caa-358d-454d-b67c-02606f7d7a0a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:26.419635 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-8d3671da-5c84-471f-865e-05b3e5746fde tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092666 Jun 15 15:59:26.420194 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 444/895] 10.222.0.62 () {58 vars in 1274 bytes} [Wed Jun 15 15:59:26 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:26.517951 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d20a3caa-358d-454d-b67c-02606f7d7a0a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:26.525362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d20a3caa-358d-454d-b67c-02606f7d7a0a tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1314 microversion: 2.1 time: 0.158880 Jun 15 15:59:26.525926 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 452/896] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:26 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 15:59:26.966711 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ae847aa7-e646-4910-9f0b-543219eeb600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:26.967494 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ae847aa7-e646-4910-9f0b-543219eeb600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:26.974029 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ae847aa7-e646-4910-9f0b-543219eeb600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:26.974480 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ae847aa7-e646-4910-9f0b-543219eeb600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:26.975334 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ae847aa7-e646-4910-9f0b-543219eeb600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:26.975805 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ae847aa7-e646-4910-9f0b-543219eeb600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:27.112711 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ae847aa7-e646-4910-9f0b-543219eeb600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:27.122195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ae847aa7-e646-4910-9f0b-543219eeb600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:27.123813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ae847aa7-e646-4910-9f0b-543219eeb600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:27.124993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ae847aa7-e646-4910-9f0b-543219eeb600 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1745 microversion: 2.20 time: 0.162751 Jun 15 15:59:27.125554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 445/897] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:26 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:27.230178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-27a657ce-932a-46ee-96c6-4b2aa6a13518 req-ce7bb5de-b761-4fdf-965b-33fc4fddef4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3786843-5891-48e9-98a3-7f6dcbbd58b6", "name": "network-vif-plugged", "status": "completed", "tag": "97c547d4-a8f9-45aa-bfcd-ee85032bfc25"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:27.240872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-27a657ce-932a-46ee-96c6-4b2aa6a13518 req-ce7bb5de-b761-4fdf-965b-33fc4fddef4a service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:27.241317 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-27a657ce-932a-46ee-96c6-4b2aa6a13518 req-ce7bb5de-b761-4fdf-965b-33fc4fddef4a service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:27.255420 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-27a657ce-932a-46ee-96c6-4b2aa6a13518 req-ce7bb5de-b761-4fdf-965b-33fc4fddef4a service nova] Creating event network-vif-plugged:97c547d4-a8f9-45aa-bfcd-ee85032bfc25 for instance f3786843-5891-48e9-98a3-7f6dcbbd58b6 on hv-cinder-84599 Jun 15 15:59:27.260581 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-27a657ce-932a-46ee-96c6-4b2aa6a13518 req-ce7bb5de-b761-4fdf-965b-33fc4fddef4a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035455 Jun 15 15:59:27.261314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 453/898] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:27.543213 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-68a6325f-4b18-472f-9775-1943e8e05365 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:27.543828 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-68a6325f-4b18-472f-9775-1943e8e05365 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:27.550189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-68a6325f-4b18-472f-9775-1943e8e05365 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:27.550632 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-68a6325f-4b18-472f-9775-1943e8e05365 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:27.551431 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-68a6325f-4b18-472f-9775-1943e8e05365 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:27.551861 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-68a6325f-4b18-472f-9775-1943e8e05365 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:27.632215 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-100b16c0-c9ac-44e6-ae9b-0aee5e420e6a req-d87f02d7-06a3-44fe-868f-4e8ab0310ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd8dffe-820f-45e3-925c-881780df5c8d", "tag": "7f8a4730-b2cf-4a02-87a9-0dd60103021a"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:27.641655 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-100b16c0-c9ac-44e6-ae9b-0aee5e420e6a req-d87f02d7-06a3-44fe-868f-4e8ab0310ca0 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:27.642196 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-100b16c0-c9ac-44e6-ae9b-0aee5e420e6a req-d87f02d7-06a3-44fe-868f-4e8ab0310ca0 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:27.654960 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-100b16c0-c9ac-44e6-ae9b-0aee5e420e6a req-d87f02d7-06a3-44fe-868f-4e8ab0310ca0 service nova] Creating event network-changed:7f8a4730-b2cf-4a02-87a9-0dd60103021a for instance acd8dffe-820f-45e3-925c-881780df5c8d on hv-cinder-84599 Jun 15 15:59:27.660831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-100b16c0-c9ac-44e6-ae9b-0aee5e420e6a req-d87f02d7-06a3-44fe-868f-4e8ab0310ca0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036801 Jun 15 15:59:27.661720 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 454/899] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:27.699563 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-68a6325f-4b18-472f-9775-1943e8e05365 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:27.709055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-68a6325f-4b18-472f-9775-1943e8e05365 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1314 microversion: 2.1 time: 0.170147 Jun 15 15:59:27.709650 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 446/900] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:27 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:28.143464 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-11c7ee8a-bef5-4dbb-8f86-9c0939740af7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:28.144187 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-11c7ee8a-bef5-4dbb-8f86-9c0939740af7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:28.150795 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-11c7ee8a-bef5-4dbb-8f86-9c0939740af7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:28.151818 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-11c7ee8a-bef5-4dbb-8f86-9c0939740af7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:28.152598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-11c7ee8a-bef5-4dbb-8f86-9c0939740af7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:28.153033 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-11c7ee8a-bef5-4dbb-8f86-9c0939740af7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:28.292716 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-11c7ee8a-bef5-4dbb-8f86-9c0939740af7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:28.302135 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-11c7ee8a-bef5-4dbb-8f86-9c0939740af7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:28.303792 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-11c7ee8a-bef5-4dbb-8f86-9c0939740af7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:28.304948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-11c7ee8a-bef5-4dbb-8f86-9c0939740af7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1745 microversion: 2.20 time: 0.165862 Jun 15 15:59:28.305507 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 455/901] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:28 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:28.725448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1187c040-a1ae-48e8-90ac-80ed106c668f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:28.726051 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1187c040-a1ae-48e8-90ac-80ed106c668f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:28.733131 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1187c040-a1ae-48e8-90ac-80ed106c668f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:28.733573 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1187c040-a1ae-48e8-90ac-80ed106c668f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:28.734326 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1187c040-a1ae-48e8-90ac-80ed106c668f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:28.734765 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1187c040-a1ae-48e8-90ac-80ed106c668f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:28.860565 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1187c040-a1ae-48e8-90ac-80ed106c668f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:28.867935 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1187c040-a1ae-48e8-90ac-80ed106c668f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1314 microversion: 2.1 time: 0.146426 Jun 15 15:59:28.868493 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 447/902] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:28 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:29.324489 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-db7ff39f-89c5-4108-a673-8d77ff2967a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:29.325665 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-db7ff39f-89c5-4108-a673-8d77ff2967a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:29.332505 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-db7ff39f-89c5-4108-a673-8d77ff2967a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:29.332948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-db7ff39f-89c5-4108-a673-8d77ff2967a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:29.333717 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-db7ff39f-89c5-4108-a673-8d77ff2967a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:29.334158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-db7ff39f-89c5-4108-a673-8d77ff2967a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:29.465425 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-db7ff39f-89c5-4108-a673-8d77ff2967a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:29.473348 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-db7ff39f-89c5-4108-a673-8d77ff2967a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:29.474927 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-db7ff39f-89c5-4108-a673-8d77ff2967a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:29.476100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-db7ff39f-89c5-4108-a673-8d77ff2967a2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1745 microversion: 2.20 time: 0.156805 Jun 15 15:59:29.476647 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 456/903] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:29 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:29.884956 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-021d42c1-faa8-4dfd-b080-bc87bae5b21f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:29.885559 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-021d42c1-faa8-4dfd-b080-bc87bae5b21f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:29.891971 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-021d42c1-faa8-4dfd-b080-bc87bae5b21f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:29.892411 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-021d42c1-faa8-4dfd-b080-bc87bae5b21f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:29.893181 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-021d42c1-faa8-4dfd-b080-bc87bae5b21f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:29.893606 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-021d42c1-faa8-4dfd-b080-bc87bae5b21f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:30.024728 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-021d42c1-faa8-4dfd-b080-bc87bae5b21f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:30.033463 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-021d42c1-faa8-4dfd-b080-bc87bae5b21f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1314 microversion: 2.1 time: 0.152052 Jun 15 15:59:30.034039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 448/904] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:29 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:30.494467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-fbfc5211-ab3b-484d-8035-2bd28e69a989 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:30.495628 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-fbfc5211-ab3b-484d-8035-2bd28e69a989 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:30.501778 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fbfc5211-ab3b-484d-8035-2bd28e69a989 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:30.502226 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fbfc5211-ab3b-484d-8035-2bd28e69a989 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:30.503012 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fbfc5211-ab3b-484d-8035-2bd28e69a989 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:30.503445 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fbfc5211-ab3b-484d-8035-2bd28e69a989 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:30.629539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fbfc5211-ab3b-484d-8035-2bd28e69a989 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:30.638028 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fbfc5211-ab3b-484d-8035-2bd28e69a989 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:30.639553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fbfc5211-ab3b-484d-8035-2bd28e69a989 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:30.640696 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fbfc5211-ab3b-484d-8035-2bd28e69a989 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1745 microversion: 2.20 time: 0.150131 Jun 15 15:59:30.641245 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 457/905] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:30 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:31.050102 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5b277d28-8791-46c3-ace5-5995ed782177 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:31.050717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5b277d28-8791-46c3-ace5-5995ed782177 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:31.057238 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b277d28-8791-46c3-ace5-5995ed782177 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:31.058302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b277d28-8791-46c3-ace5-5995ed782177 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:31.059090 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b277d28-8791-46c3-ace5-5995ed782177 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:31.059528 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b277d28-8791-46c3-ace5-5995ed782177 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:31.188622 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5b277d28-8791-46c3-ace5-5995ed782177 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:31.196148 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5b277d28-8791-46c3-ace5-5995ed782177 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1497 microversion: 2.1 time: 0.150042 Jun 15 15:59:31.196702 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 449/906] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:31 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:31.659427 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-420d5ff3-208a-4d13-9b9a-069c18bc9c06 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:31.659959 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-420d5ff3-208a-4d13-9b9a-069c18bc9c06 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:31.666595 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-420d5ff3-208a-4d13-9b9a-069c18bc9c06 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:31.667343 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-420d5ff3-208a-4d13-9b9a-069c18bc9c06 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:31.668114 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-420d5ff3-208a-4d13-9b9a-069c18bc9c06 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:31.668559 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-420d5ff3-208a-4d13-9b9a-069c18bc9c06 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:31.768157 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-350d08aa-2e9f-4f09-85c4-f953e05cc8f4 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:31.768659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-350d08aa-2e9f-4f09-85c4-f953e05cc8f4 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:31.774675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-350d08aa-2e9f-4f09-85c4-f953e05cc8f4 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:31.775158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-350d08aa-2e9f-4f09-85c4-f953e05cc8f4 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:31.775922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-350d08aa-2e9f-4f09-85c4-f953e05cc8f4 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:31.776419 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-350d08aa-2e9f-4f09-85c4-f953e05cc8f4 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:31.780966 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=100 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:31.797470 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-420d5ff3-208a-4d13-9b9a-069c18bc9c06 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:31.803049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-350d08aa-2e9f-4f09-85c4-f953e05cc8f4 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Going to try to terminate instance {{(pid=123935) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 15:59:31.805378 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-420d5ff3-208a-4d13-9b9a-069c18bc9c06 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:31.806907 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-420d5ff3-208a-4d13-9b9a-069c18bc9c06 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:31.808124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-420d5ff3-208a-4d13-9b9a-069c18bc9c06 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1745 microversion: 2.20 time: 0.153212 Jun 15 15:59:31.808677 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 458/907] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:31 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:31.875589 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-350d08aa-2e9f-4f09-85c4-f953e05cc8f4 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 204 len: 0 microversion: 2.1 time: 0.111092 Jun 15 15:59:31.876239 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 450/908] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 15:59:31 2022] DELETE /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 15 15:59:31.885005 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4c6be639-db28-499d-b3f2-ffe6903db4b0 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:31.886131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4c6be639-db28-499d-b3f2-ffe6903db4b0 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:31.892238 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4c6be639-db28-499d-b3f2-ffe6903db4b0 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:31.892725 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4c6be639-db28-499d-b3f2-ffe6903db4b0 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:31.893482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4c6be639-db28-499d-b3f2-ffe6903db4b0 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:31.893912 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4c6be639-db28-499d-b3f2-ffe6903db4b0 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:32.022002 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4c6be639-db28-499d-b3f2-ffe6903db4b0 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:32.029923 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4c6be639-db28-499d-b3f2-ffe6903db4b0 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1503 microversion: 2.1 time: 0.148712 Jun 15 15:59:32.030489 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 459/909] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:31 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:32.827562 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ec3ba5a0-5c29-46d4-be94-326aaf3c536f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:32.828182 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ec3ba5a0-5c29-46d4-be94-326aaf3c536f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:32.834377 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ec3ba5a0-5c29-46d4-be94-326aaf3c536f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:32.834871 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ec3ba5a0-5c29-46d4-be94-326aaf3c536f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:32.835637 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ec3ba5a0-5c29-46d4-be94-326aaf3c536f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:32.836075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ec3ba5a0-5c29-46d4-be94-326aaf3c536f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:32.961222 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ec3ba5a0-5c29-46d4-be94-326aaf3c536f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:32.969092 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ec3ba5a0-5c29-46d4-be94-326aaf3c536f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:32.970615 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-ec3ba5a0-5c29-46d4-be94-326aaf3c536f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:32.971798 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ec3ba5a0-5c29-46d4-be94-326aaf3c536f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1745 microversion: 2.20 time: 0.149295 Jun 15 15:59:32.972360 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 451/910] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:32 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:33.047457 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e47b0b64-a751-48cf-979b-0c60e4d75cbd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:33.048058 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e47b0b64-a751-48cf-979b-0c60e4d75cbd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:33.054452 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e47b0b64-a751-48cf-979b-0c60e4d75cbd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:33.054927 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e47b0b64-a751-48cf-979b-0c60e4d75cbd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:33.055674 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e47b0b64-a751-48cf-979b-0c60e4d75cbd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:33.056099 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e47b0b64-a751-48cf-979b-0c60e4d75cbd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:33.183703 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e47b0b64-a751-48cf-979b-0c60e4d75cbd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:33.191062 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e47b0b64-a751-48cf-979b-0c60e4d75cbd tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1503 microversion: 2.1 time: 0.147378 Jun 15 15:59:33.191613 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 460/911] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:33 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:33.989579 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7e655955-accd-4caa-a7c2-16364d928b1f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:33.990174 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7e655955-accd-4caa-a7c2-16364d928b1f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:33.996675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e655955-accd-4caa-a7c2-16364d928b1f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:33.997117 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e655955-accd-4caa-a7c2-16364d928b1f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:33.997860 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e655955-accd-4caa-a7c2-16364d928b1f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:33.998286 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e655955-accd-4caa-a7c2-16364d928b1f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:34.129039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7e655955-accd-4caa-a7c2-16364d928b1f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:34.148357 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7e655955-accd-4caa-a7c2-16364d928b1f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:34.150008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7e655955-accd-4caa-a7c2-16364d928b1f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:34.151867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7e655955-accd-4caa-a7c2-16364d928b1f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.165592 Jun 15 15:59:34.152764 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 452/912] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:33 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:34.207535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8059a3ff-ce17-4e12-90dd-c351058a8ab2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:34.208278 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8059a3ff-ce17-4e12-90dd-c351058a8ab2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:34.215000 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8059a3ff-ce17-4e12-90dd-c351058a8ab2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:34.215450 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8059a3ff-ce17-4e12-90dd-c351058a8ab2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:34.216222 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8059a3ff-ce17-4e12-90dd-c351058a8ab2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:34.216655 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8059a3ff-ce17-4e12-90dd-c351058a8ab2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:34.363855 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8059a3ff-ce17-4e12-90dd-c351058a8ab2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:34.367616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:34.373156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8059a3ff-ce17-4e12-90dd-c351058a8ab2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1503 microversion: 2.1 time: 0.169430 Jun 15 15:59:34.374311 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 461/913] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:34 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:34.760558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-13c18c2e-b452-4c22-969c-6d25494627b0 req-ea0c5c80-9645-4c03-bfed-7fbc0c6d796e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3786843-5891-48e9-98a3-7f6dcbbd58b6", "name": "network-vif-deleted", "tag": "97c547d4-a8f9-45aa-bfcd-ee85032bfc25"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:34.771562 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-13c18c2e-b452-4c22-969c-6d25494627b0 req-ea0c5c80-9645-4c03-bfed-7fbc0c6d796e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:34.772036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-13c18c2e-b452-4c22-969c-6d25494627b0 req-ea0c5c80-9645-4c03-bfed-7fbc0c6d796e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:34.784066 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-13c18c2e-b452-4c22-969c-6d25494627b0 req-ea0c5c80-9645-4c03-bfed-7fbc0c6d796e service nova] Creating event network-vif-deleted:97c547d4-a8f9-45aa-bfcd-ee85032bfc25 for instance f3786843-5891-48e9-98a3-7f6dcbbd58b6 on hv-cinder-84599 Jun 15 15:59:34.791086 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-13c18c2e-b452-4c22-969c-6d25494627b0 req-ea0c5c80-9645-4c03-bfed-7fbc0c6d796e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034118 Jun 15 15:59:34.792962 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 453/914] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:35.173173 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2c981a44-6bdb-424c-b149-8d5fe37f6c50 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:35.174275 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2c981a44-6bdb-424c-b149-8d5fe37f6c50 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:35.180392 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2c981a44-6bdb-424c-b149-8d5fe37f6c50 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:35.180842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2c981a44-6bdb-424c-b149-8d5fe37f6c50 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:35.181799 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2c981a44-6bdb-424c-b149-8d5fe37f6c50 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:35.182235 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2c981a44-6bdb-424c-b149-8d5fe37f6c50 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:35.318375 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2c981a44-6bdb-424c-b149-8d5fe37f6c50 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:35.327838 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2c981a44-6bdb-424c-b149-8d5fe37f6c50 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:35.329323 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2c981a44-6bdb-424c-b149-8d5fe37f6c50 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:35.330468 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2c981a44-6bdb-424c-b149-8d5fe37f6c50 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.162879 Jun 15 15:59:35.331039 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 462/915] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:35 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:35.395074 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8cf8925b-06fa-4752-a3ca-b8b7487ba6b2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:35.395892 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-8cf8925b-06fa-4752-a3ca-b8b7487ba6b2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:35.403270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8cf8925b-06fa-4752-a3ca-b8b7487ba6b2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:35.403831 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8cf8925b-06fa-4752-a3ca-b8b7487ba6b2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:35.404769 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8cf8925b-06fa-4752-a3ca-b8b7487ba6b2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:35.405366 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8cf8925b-06fa-4752-a3ca-b8b7487ba6b2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:35.439562 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8cf8925b-06fa-4752-a3ca-b8b7487ba6b2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:35.440248 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8cf8925b-06fa-4752-a3ca-b8b7487ba6b2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:35.440894 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-8cf8925b-06fa-4752-a3ca-b8b7487ba6b2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lazy-loading 'fault' on Instance uuid f3786843-5891-48e9-98a3-7f6dcbbd58b6 {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 15:59:35.485618 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8cf8925b-06fa-4752-a3ca-b8b7487ba6b2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00609e23ec8d4eadb9709b4e497810e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4babb3ea9898402ba7898395d59b4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:35.494276 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-8cf8925b-06fa-4752-a3ca-b8b7487ba6b2 tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 200 len: 1304 microversion: 2.1 time: 0.104112 Jun 15 15:59:35.496290 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 454/916] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:35 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 15:59:36.351054 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4a6f12ac-e4f5-4f63-b805-5e4508b557ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:36.351836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4a6f12ac-e4f5-4f63-b805-5e4508b557ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:36.358902 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a6f12ac-e4f5-4f63-b805-5e4508b557ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:36.359437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a6f12ac-e4f5-4f63-b805-5e4508b557ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:36.360294 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a6f12ac-e4f5-4f63-b805-5e4508b557ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:36.360971 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a6f12ac-e4f5-4f63-b805-5e4508b557ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:36.507574 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4a6f12ac-e4f5-4f63-b805-5e4508b557ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:36.513006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e6e54f42-29e6-46f2-9857-05d24893497f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:36.513836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e6e54f42-29e6-46f2-9857-05d24893497f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] [instance: f3786843-5891-48e9-98a3-7f6dcbbd58b6] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:36.518028 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4a6f12ac-e4f5-4f63-b805-5e4508b557ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:36.519788 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4a6f12ac-e4f5-4f63-b805-5e4508b557ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:36.520675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6e54f42-29e6-46f2-9857-05d24893497f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:36.521132 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6e54f42-29e6-46f2-9857-05d24893497f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:36.521684 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4a6f12ac-e4f5-4f63-b805-5e4508b557ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.174429 Jun 15 15:59:36.521904 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6e54f42-29e6-46f2-9857-05d24893497f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:36.522338 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6e54f42-29e6-46f2-9857-05d24893497f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:36.522645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 463/917] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:36 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:36.541977 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-e6e54f42-29e6-46f2-9857-05d24893497f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] HTTP exception thrown: Instance f3786843-5891-48e9-98a3-7f6dcbbd58b6 could not be found. Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e6e54f42-29e6-46f2-9857-05d24893497f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Request method failure captured: Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 HTTP/1.1 Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgG8AAmfT5o26p_vMwmaOt0mFHKGN99gy0MUfG4odRGdHg0dZMZLUQVK8dtF58YTe4SVT-ax370hR-2mlb-aq_skKc8sCgVADmCvmtehOF_09-WXumxfF4VJSP8JnN0ExlhPP2L8NT4UlLlFzs6qZlh0BPVZbBpJt9i0bAfWtyTsjD0 Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 4babb3ea9898402ba7898395d59b4beb Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-VolumesActionsTest-1375842701 Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 15:59:36.543895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4babb3ea9898402ba7898395d59b4beb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4babb3ea9898402ba7898395d59b4beb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4babb3ea9898402ba7898395d59b4beb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4babb3ea9898402ba7898395d59b4beb", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-VolumesActionsTest-1375842701 Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 4babb3ea9898402ba7898395d59b4beb Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-VolumesActionsTest-1375842701 Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-VolumesActionsTest-1375842701-project Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 00609e23ec8d4eadb9709b4e497810e3 Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-VolumesActionsTest-1375842701-project Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance f3786843-5891-48e9-98a3-7f6dcbbd58b6 could not be found. Jun 15 15:59:36.545268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'f3786843-5891-48e9-98a3-7f6dcbbd58b6'} Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3786843-5891-48e9-98a3-7f6dcbbd58b6 could not be found. Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 15:59:36.546055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3786843-5891-48e9-98a3-7f6dcbbd58b6 could not be found. Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3786843-5891-48e9-98a3-7f6dcbbd58b6 could not be found. Jun 15 15:59:36.547353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 15:59:36.548454 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e6e54f42-29e6-46f2-9857-05d24893497f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] Returning 404 to user: Instance f3786843-5891-48e9-98a3-7f6dcbbd58b6 could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 15:59:36.548454 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e6e54f42-29e6-46f2-9857-05d24893497f tempest-VolumesActionsTest-1375842701 tempest-VolumesActionsTest-1375842701-project] 10.222.0.62 "GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6" status: 404 len: 111 microversion: 2.1 time: 0.036837 Jun 15 15:59:36.548454 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 455/918] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 15:59:36 2022] GET /compute/v2.1/servers/f3786843-5891-48e9-98a3-7f6dcbbd58b6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 15:59:37.540254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bf7e4e94-bad5-484c-a0ed-03599411f023 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:37.541065 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bf7e4e94-bad5-484c-a0ed-03599411f023 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:37.549579 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf7e4e94-bad5-484c-a0ed-03599411f023 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:37.550175 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf7e4e94-bad5-484c-a0ed-03599411f023 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:37.551047 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf7e4e94-bad5-484c-a0ed-03599411f023 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:37.551545 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf7e4e94-bad5-484c-a0ed-03599411f023 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:37.706817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bf7e4e94-bad5-484c-a0ed-03599411f023 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:37.715447 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bf7e4e94-bad5-484c-a0ed-03599411f023 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:37.716985 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bf7e4e94-bad5-484c-a0ed-03599411f023 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:37.718142 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bf7e4e94-bad5-484c-a0ed-03599411f023 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.181933 Jun 15 15:59:37.718698 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 464/919] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:37 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:38.737752 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0c7fce18-1365-4a88-99be-f27886bc25a0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:38.738295 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0c7fce18-1365-4a88-99be-f27886bc25a0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:38.745513 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0c7fce18-1365-4a88-99be-f27886bc25a0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:38.745961 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0c7fce18-1365-4a88-99be-f27886bc25a0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:38.746749 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0c7fce18-1365-4a88-99be-f27886bc25a0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:38.747388 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0c7fce18-1365-4a88-99be-f27886bc25a0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:38.885235 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0c7fce18-1365-4a88-99be-f27886bc25a0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:38.894214 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0c7fce18-1365-4a88-99be-f27886bc25a0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:38.895996 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0c7fce18-1365-4a88-99be-f27886bc25a0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:38.897260 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0c7fce18-1365-4a88-99be-f27886bc25a0 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.163671 Jun 15 15:59:38.898034 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 456/920] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:38 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:39.914997 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1d0a0499-fff7-4ffe-8f20-428943b832fb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:39.915597 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1d0a0499-fff7-4ffe-8f20-428943b832fb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:39.923197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d0a0499-fff7-4ffe-8f20-428943b832fb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:39.923642 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d0a0499-fff7-4ffe-8f20-428943b832fb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:39.924409 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d0a0499-fff7-4ffe-8f20-428943b832fb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:39.924844 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d0a0499-fff7-4ffe-8f20-428943b832fb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:40.062416 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1d0a0499-fff7-4ffe-8f20-428943b832fb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:40.070638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1d0a0499-fff7-4ffe-8f20-428943b832fb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:40.072363 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1d0a0499-fff7-4ffe-8f20-428943b832fb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:40.073548 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1d0a0499-fff7-4ffe-8f20-428943b832fb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.162563 Jun 15 15:59:40.084504 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 465/921] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:39 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:41.093991 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-476a7257-985e-4e6d-a649-aed8ae8229d9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:41.094686 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-476a7257-985e-4e6d-a649-aed8ae8229d9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:41.101767 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-476a7257-985e-4e6d-a649-aed8ae8229d9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:41.102221 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-476a7257-985e-4e6d-a649-aed8ae8229d9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:41.103425 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-476a7257-985e-4e6d-a649-aed8ae8229d9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:41.104188 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-476a7257-985e-4e6d-a649-aed8ae8229d9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:41.252341 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-476a7257-985e-4e6d-a649-aed8ae8229d9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:41.260593 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-476a7257-985e-4e6d-a649-aed8ae8229d9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:41.262852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-476a7257-985e-4e6d-a649-aed8ae8229d9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:41.264081 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-476a7257-985e-4e6d-a649-aed8ae8229d9 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.174714 Jun 15 15:59:41.264636 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 457/922] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:41 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:42.282227 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-becef1c8-c5a1-46b9-a915-a36660a6215e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:42.283227 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-becef1c8-c5a1-46b9-a915-a36660a6215e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:42.290334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-becef1c8-c5a1-46b9-a915-a36660a6215e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:42.290835 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-becef1c8-c5a1-46b9-a915-a36660a6215e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:42.294520 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-becef1c8-c5a1-46b9-a915-a36660a6215e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:42.294520 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-becef1c8-c5a1-46b9-a915-a36660a6215e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:42.468829 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-becef1c8-c5a1-46b9-a915-a36660a6215e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:42.478588 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-becef1c8-c5a1-46b9-a915-a36660a6215e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:42.482608 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-becef1c8-c5a1-46b9-a915-a36660a6215e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:42.482608 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-becef1c8-c5a1-46b9-a915-a36660a6215e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.203762 Jun 15 15:59:42.482608 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 466/923] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:42 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:43.499496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d59aece8-b94b-4f8d-8401-c6ffb23a7770 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:43.500103 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d59aece8-b94b-4f8d-8401-c6ffb23a7770 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:43.506890 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d59aece8-b94b-4f8d-8401-c6ffb23a7770 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:43.507357 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d59aece8-b94b-4f8d-8401-c6ffb23a7770 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:43.508130 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d59aece8-b94b-4f8d-8401-c6ffb23a7770 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:43.508564 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d59aece8-b94b-4f8d-8401-c6ffb23a7770 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:43.646075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d59aece8-b94b-4f8d-8401-c6ffb23a7770 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:43.657097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d59aece8-b94b-4f8d-8401-c6ffb23a7770 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:43.659358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d59aece8-b94b-4f8d-8401-c6ffb23a7770 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:43.660587 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d59aece8-b94b-4f8d-8401-c6ffb23a7770 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.165125 Jun 15 15:59:43.667111 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 458/924] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:43 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:44.678933 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cf82690c-2b6c-4856-970f-4f06a6f27abc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:44.680214 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-cf82690c-2b6c-4856-970f-4f06a6f27abc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:44.687655 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf82690c-2b6c-4856-970f-4f06a6f27abc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:44.688131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf82690c-2b6c-4856-970f-4f06a6f27abc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:44.688917 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf82690c-2b6c-4856-970f-4f06a6f27abc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:44.689617 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf82690c-2b6c-4856-970f-4f06a6f27abc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:44.842077 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cf82690c-2b6c-4856-970f-4f06a6f27abc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:44.851036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cf82690c-2b6c-4856-970f-4f06a6f27abc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:44.853165 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cf82690c-2b6c-4856-970f-4f06a6f27abc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:44.854621 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-cf82690c-2b6c-4856-970f-4f06a6f27abc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.179768 Jun 15 15:59:44.855249 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 467/925] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:44 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:45.873809 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6a822194-e450-4c6f-adee-3e50b1eb3c67 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:45.875311 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6a822194-e450-4c6f-adee-3e50b1eb3c67 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:45.882896 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:45.884833 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6a822194-e450-4c6f-adee-3e50b1eb3c67 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:45.885741 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6a822194-e450-4c6f-adee-3e50b1eb3c67 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:45.886864 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6a822194-e450-4c6f-adee-3e50b1eb3c67 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:45.887539 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6a822194-e450-4c6f-adee-3e50b1eb3c67 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:46.071232 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6a822194-e450-4c6f-adee-3e50b1eb3c67 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:46.090308 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6a822194-e450-4c6f-adee-3e50b1eb3c67 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:46.092395 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6a822194-e450-4c6f-adee-3e50b1eb3c67 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:46.094107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6a822194-e450-4c6f-adee-3e50b1eb3c67 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.225157 Jun 15 15:59:46.105690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 459/926] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:45 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:46.515518 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b2beee1e-d246-4264-976e-0cdcb6c324a5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:46.516072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b2beee1e-d246-4264-976e-0cdcb6c324a5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:46.533836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2beee1e-d246-4264-976e-0cdcb6c324a5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:46.534291 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2beee1e-d246-4264-976e-0cdcb6c324a5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:46.535279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2beee1e-d246-4264-976e-0cdcb6c324a5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:46.535808 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b2beee1e-d246-4264-976e-0cdcb6c324a5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:46.593934 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b2beee1e-d246-4264-976e-0cdcb6c324a5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/ips" status: 200 len: 146 microversion: 2.1 time: 0.082726 Jun 15 15:59:46.594431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 468/927] 10.222.0.62 () {58 vars in 1247 bytes} [Wed Jun 15 15:59:46 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/ips => generated 146 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 15:59:47.116580 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-08391dc1-3747-4124-8693-1bd4a557170e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:47.117949 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-08391dc1-3747-4124-8693-1bd4a557170e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:47.127517 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-08391dc1-3747-4124-8693-1bd4a557170e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:47.129085 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-08391dc1-3747-4124-8693-1bd4a557170e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:47.130461 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-08391dc1-3747-4124-8693-1bd4a557170e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:47.131243 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-08391dc1-3747-4124-8693-1bd4a557170e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:47.286338 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-08391dc1-3747-4124-8693-1bd4a557170e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:47.295697 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-08391dc1-3747-4124-8693-1bd4a557170e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:47.297246 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-08391dc1-3747-4124-8693-1bd4a557170e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:47.298545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-08391dc1-3747-4124-8693-1bd4a557170e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.188167 Jun 15 15:59:47.299333 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 460/928] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:47 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:48.317952 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0e3b7073-9ec8-4bc1-b6f8-156bd82a0dfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:48.318502 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0e3b7073-9ec8-4bc1-b6f8-156bd82a0dfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:48.326246 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e3b7073-9ec8-4bc1-b6f8-156bd82a0dfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:48.326524 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e3b7073-9ec8-4bc1-b6f8-156bd82a0dfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:48.328314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e3b7073-9ec8-4bc1-b6f8-156bd82a0dfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:48.328768 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0e3b7073-9ec8-4bc1-b6f8-156bd82a0dfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:48.479437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0e3b7073-9ec8-4bc1-b6f8-156bd82a0dfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:48.488649 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0e3b7073-9ec8-4bc1-b6f8-156bd82a0dfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:48.490204 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0e3b7073-9ec8-4bc1-b6f8-156bd82a0dfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:48.491680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0e3b7073-9ec8-4bc1-b6f8-156bd82a0dfb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1740 microversion: 2.20 time: 0.178013 Jun 15 15:59:48.502688 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 469/929] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:48 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:49.127396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-eb2e47ee-1b7a-43c9-833e-c544e27b2417 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "609d877c-3ba6-4552-9b4e-7aef999d3675"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:49.129177 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-eb2e47ee-1b7a-43c9-833e-c544e27b2417 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:49.137907 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eb2e47ee-1b7a-43c9-833e-c544e27b2417 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:49.149244 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eb2e47ee-1b7a-43c9-833e-c544e27b2417 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:49.150413 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eb2e47ee-1b7a-43c9-833e-c544e27b2417 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:49.151058 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eb2e47ee-1b7a-43c9-833e-c544e27b2417 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:49.501888 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-eb2e47ee-1b7a-43c9-833e-c544e27b2417 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "POST /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378262 Jun 15 15:59:49.520024 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a805d26a-1b87-4f8a-afcc-c8c7286b27bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:49.525069 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a805d26a-1b87-4f8a-afcc-c8c7286b27bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:49.533117 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 461/930] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 15:59:49 2022] POST /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:49.537659 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a805d26a-1b87-4f8a-afcc-c8c7286b27bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:49.538438 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a805d26a-1b87-4f8a-afcc-c8c7286b27bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:49.543263 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a805d26a-1b87-4f8a-afcc-c8c7286b27bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:49.544183 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a805d26a-1b87-4f8a-afcc-c8c7286b27bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:49.732724 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a805d26a-1b87-4f8a-afcc-c8c7286b27bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:49.743344 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a805d26a-1b87-4f8a-afcc-c8c7286b27bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:49.745159 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a805d26a-1b87-4f8a-afcc-c8c7286b27bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:49.746767 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a805d26a-1b87-4f8a-afcc-c8c7286b27bb tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1722 microversion: 2.20 time: 0.237587 Jun 15 15:59:49.747480 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 470/931] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:49 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:50.769050 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-afc6f7d7-5986-4a9f-a714-576157ec4689 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:50.769946 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-afc6f7d7-5986-4a9f-a714-576157ec4689 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:50.779063 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-afc6f7d7-5986-4a9f-a714-576157ec4689 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:50.779750 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-afc6f7d7-5986-4a9f-a714-576157ec4689 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:50.780675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-afc6f7d7-5986-4a9f-a714-576157ec4689 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:50.781216 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-afc6f7d7-5986-4a9f-a714-576157ec4689 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:50.929887 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-afc6f7d7-5986-4a9f-a714-576157ec4689 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:50.943784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-afc6f7d7-5986-4a9f-a714-576157ec4689 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:50.945358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-afc6f7d7-5986-4a9f-a714-576157ec4689 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:50.946545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-afc6f7d7-5986-4a9f-a714-576157ec4689 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1722 microversion: 2.20 time: 0.183629 Jun 15 15:59:50.947338 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 462/932] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:50 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:51.965635 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-90f7ca04-8dab-4c2c-bdac-a5e129c4c36f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:51.966178 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-90f7ca04-8dab-4c2c-bdac-a5e129c4c36f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:51.973401 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-90f7ca04-8dab-4c2c-bdac-a5e129c4c36f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:51.973847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-90f7ca04-8dab-4c2c-bdac-a5e129c4c36f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:51.974920 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-90f7ca04-8dab-4c2c-bdac-a5e129c4c36f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:51.975395 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-90f7ca04-8dab-4c2c-bdac-a5e129c4c36f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:52.168548 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-90f7ca04-8dab-4c2c-bdac-a5e129c4c36f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:52.180977 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-90f7ca04-8dab-4c2c-bdac-a5e129c4c36f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:52.183607 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-90f7ca04-8dab-4c2c-bdac-a5e129c4c36f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:52.187971 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-90f7ca04-8dab-4c2c-bdac-a5e129c4c36f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1722 microversion: 2.20 time: 0.226110 Jun 15 15:59:52.189217 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 471/933] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:51 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:52.191556 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-204dfb78-53c4-4fd1-9e29-1574d8fd61b6 req-aac817e7-ccd1-4f42-a078-0f7446122c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c4bb33d-2d9f-4620-9e94-f28e12cd604f", "name": "network-vif-unplugged", "status": "completed", "tag": "6153ea23-abc5-46cb-96ff-6597e6888d85"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:52.202672 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-204dfb78-53c4-4fd1-9e29-1574d8fd61b6 req-aac817e7-ccd1-4f42-a078-0f7446122c6e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:52.203798 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-204dfb78-53c4-4fd1-9e29-1574d8fd61b6 req-aac817e7-ccd1-4f42-a078-0f7446122c6e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:52.215523 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-204dfb78-53c4-4fd1-9e29-1574d8fd61b6 req-aac817e7-ccd1-4f42-a078-0f7446122c6e service nova] Creating event network-vif-unplugged:6153ea23-abc5-46cb-96ff-6597e6888d85 for instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f on hv-cinder-84599 Jun 15 15:59:52.223339 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-204dfb78-53c4-4fd1-9e29-1574d8fd61b6 req-aac817e7-ccd1-4f42-a078-0f7446122c6e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035410 Jun 15 15:59:52.224564 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 463/934] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 15:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:53.208525 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f14ac5be-acb3-4770-99ff-eb6d5f6951ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:53.209130 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f14ac5be-acb3-4770-99ff-eb6d5f6951ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:53.215725 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f14ac5be-acb3-4770-99ff-eb6d5f6951ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:53.216389 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f14ac5be-acb3-4770-99ff-eb6d5f6951ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:53.217400 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f14ac5be-acb3-4770-99ff-eb6d5f6951ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:53.217991 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f14ac5be-acb3-4770-99ff-eb6d5f6951ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:53.360163 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f14ac5be-acb3-4770-99ff-eb6d5f6951ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:53.368704 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f14ac5be-acb3-4770-99ff-eb6d5f6951ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:53.370235 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f14ac5be-acb3-4770-99ff-eb6d5f6951ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:53.371767 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f14ac5be-acb3-4770-99ff-eb6d5f6951ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1665 microversion: 2.20 time: 0.167125 Jun 15 15:59:53.385696 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 472/935] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:53 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1665 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:53.392220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-62d34eb3-35ce-47e9-9e78-9bf9479c9344 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55a9bb4c-4206-49b8-921d-437a6fab1fba"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:53.393365 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-62d34eb3-35ce-47e9-9e78-9bf9479c9344 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:53.401137 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-62d34eb3-35ce-47e9-9e78-9bf9479c9344 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:53.401744 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-62d34eb3-35ce-47e9-9e78-9bf9479c9344 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:53.402363 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-62d34eb3-35ce-47e9-9e78-9bf9479c9344 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:53.402856 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-62d34eb3-35ce-47e9-9e78-9bf9479c9344 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:53.810432 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:53.928039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-62d34eb3-35ce-47e9-9e78-9bf9479c9344 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "POST /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.540529 Jun 15 15:59:53.934924 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 464/936] 10.222.0.62 () {62 vars in 1363 bytes} [Wed Jun 15 15:59:53 2022] POST /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/os-volume_attachments => generated 188 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 15 15:59:54.063442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0c3317a8-eb42-4c52-be4b-2b445f632ab2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:54.064319 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0c3317a8-eb42-4c52-be4b-2b445f632ab2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:54.071403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c3317a8-eb42-4c52-be4b-2b445f632ab2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:54.071940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c3317a8-eb42-4c52-be4b-2b445f632ab2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:54.072848 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c3317a8-eb42-4c52-be4b-2b445f632ab2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:54.073388 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c3317a8-eb42-4c52-be4b-2b445f632ab2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:54.396436 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0c3317a8-eb42-4c52-be4b-2b445f632ab2 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/os-volume_attachments/55a9bb4c-4206-49b8-921d-437a6fab1fba" status: 202 len: 0 microversion: 2.20 time: 0.336993 Jun 15 15:59:54.397808 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 473/937] 10.222.0.62 () {60 vars in 1456 bytes} [Wed Jun 15 15:59:54 2022] DELETE /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/os-volume_attachments/55a9bb4c-4206-49b8-921d-437a6fab1fba => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:59:54.464093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-295a7074-048c-4e4b-b7b7-38873fb3cbe5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 15:59:54.465633 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-295a7074-048c-4e4b-b7b7-38873fb3cbe5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:54.476620 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-295a7074-048c-4e4b-b7b7-38873fb3cbe5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:54.477450 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-295a7074-048c-4e4b-b7b7-38873fb3cbe5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:54.479130 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-295a7074-048c-4e4b-b7b7-38873fb3cbe5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:54.479541 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-295a7074-048c-4e4b-b7b7-38873fb3cbe5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:54.626049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-295a7074-048c-4e4b-b7b7-38873fb3cbe5 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "POST /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/action" status: 202 len: 0 microversion: 2.20 time: 0.167994 Jun 15 15:59:54.629287 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 465/938] 10.222.0.62 () {62 vars in 1318 bytes} [Wed Jun 15 15:59:54 2022] POST /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 15 15:59:54.639693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-552d0c09-9e9c-41dd-aa34-be37c6524289 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:54.640882 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-552d0c09-9e9c-41dd-aa34-be37c6524289 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:54.664604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-552d0c09-9e9c-41dd-aa34-be37c6524289 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:54.665350 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-552d0c09-9e9c-41dd-aa34-be37c6524289 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:54.666131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-552d0c09-9e9c-41dd-aa34-be37c6524289 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:54.666566 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-552d0c09-9e9c-41dd-aa34-be37c6524289 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:54.833839 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-552d0c09-9e9c-41dd-aa34-be37c6524289 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:54.846486 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-552d0c09-9e9c-41dd-aa34-be37c6524289 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:54.855598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-552d0c09-9e9c-41dd-aa34-be37c6524289 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:54.857920 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-552d0c09-9e9c-41dd-aa34-be37c6524289 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1673 microversion: 2.20 time: 0.223449 Jun 15 15:59:54.860580 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 474/939] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:54 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1673 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:55.878150 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e96b1931-d85a-44e6-8119-d241a980d2d4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:55.878991 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e96b1931-d85a-44e6-8119-d241a980d2d4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:55.888469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e96b1931-d85a-44e6-8119-d241a980d2d4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:55.889867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e96b1931-d85a-44e6-8119-d241a980d2d4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:55.890921 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e96b1931-d85a-44e6-8119-d241a980d2d4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:55.891591 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e96b1931-d85a-44e6-8119-d241a980d2d4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:56.052107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e96b1931-d85a-44e6-8119-d241a980d2d4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:56.061403 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e96b1931-d85a-44e6-8119-d241a980d2d4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:56.063282 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e96b1931-d85a-44e6-8119-d241a980d2d4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:56.064675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e96b1931-d85a-44e6-8119-d241a980d2d4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1675 microversion: 2.20 time: 0.192784 Jun 15 15:59:56.065761 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 466/940] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:55 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1675 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:57.085155 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5d35d8be-f477-4bfd-9f2d-f05a6fed0ead tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:57.086374 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5d35d8be-f477-4bfd-9f2d-f05a6fed0ead tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:57.095025 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=52 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:57.098207 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5d35d8be-f477-4bfd-9f2d-f05a6fed0ead tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:57.098834 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5d35d8be-f477-4bfd-9f2d-f05a6fed0ead tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:57.100166 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5d35d8be-f477-4bfd-9f2d-f05a6fed0ead tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:57.100603 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5d35d8be-f477-4bfd-9f2d-f05a6fed0ead tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:57.314207 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5d35d8be-f477-4bfd-9f2d-f05a6fed0ead tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:57.323319 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5d35d8be-f477-4bfd-9f2d-f05a6fed0ead tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:57.325141 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5d35d8be-f477-4bfd-9f2d-f05a6fed0ead tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:57.327309 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5d35d8be-f477-4bfd-9f2d-f05a6fed0ead tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.245803 Jun 15 15:59:57.328047 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 475/941] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:57 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:58.356147 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-925cedf1-192f-49c9-b35b-794d6cc8c2fc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:58.356896 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-925cedf1-192f-49c9-b35b-794d6cc8c2fc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:58.363715 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-925cedf1-192f-49c9-b35b-794d6cc8c2fc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:58.364246 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-925cedf1-192f-49c9-b35b-794d6cc8c2fc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:58.365385 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-925cedf1-192f-49c9-b35b-794d6cc8c2fc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:58.366415 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-925cedf1-192f-49c9-b35b-794d6cc8c2fc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:58.514573 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-925cedf1-192f-49c9-b35b-794d6cc8c2fc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:58.523097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-925cedf1-192f-49c9-b35b-794d6cc8c2fc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:58.524976 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-925cedf1-192f-49c9-b35b-794d6cc8c2fc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:58.526168 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-925cedf1-192f-49c9-b35b-794d6cc8c2fc tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.174714 Jun 15 15:59:58.526812 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 467/942] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:58 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 15:59:59.358576 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-98fdfb2f-fdd4-4373-9fbb-8ad3b68015e4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:59.359831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-98fdfb2f-fdd4-4373-9fbb-8ad3b68015e4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:59.366819 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-98fdfb2f-fdd4-4373-9fbb-8ad3b68015e4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:59.367424 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-98fdfb2f-fdd4-4373-9fbb-8ad3b68015e4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:59.368290 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-98fdfb2f-fdd4-4373-9fbb-8ad3b68015e4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:59.368814 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-98fdfb2f-fdd4-4373-9fbb-8ad3b68015e4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:59.398353 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 15:59:59.450298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-98fdfb2f-fdd4-4373-9fbb-8ad3b68015e4 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095831 Jun 15 15:59:59.451691 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 476/943] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 15:59:59 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:59.466306 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-61b87332-4365-43bf-ac23-606c650d1f7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:59.469062 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-61b87332-4365-43bf-ac23-606c650d1f7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:59.480207 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61b87332-4365-43bf-ac23-606c650d1f7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:59.480970 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61b87332-4365-43bf-ac23-606c650d1f7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:59.481933 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61b87332-4365-43bf-ac23-606c650d1f7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:59.483130 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-61b87332-4365-43bf-ac23-606c650d1f7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:59.526491 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-61b87332-4365-43bf-ac23-606c650d1f7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments/609d877c-3ba6-4552-9b4e-7aef999d3675" status: 200 len: 194 microversion: 2.1 time: 0.064482 Jun 15 15:59:59.527442 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 468/944] 10.222.0.62 () {58 vars in 1412 bytes} [Wed Jun 15 15:59:59 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments/609d877c-3ba6-4552-9b4e-7aef999d3675 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 15:59:59.546211 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-75c6d18a-a745-4cd2-bdbd-f45421724246 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 15:59:59.546858 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-75c6d18a-a745-4cd2-bdbd-f45421724246 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 15:59:59.566351 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-75c6d18a-a745-4cd2-bdbd-f45421724246 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:59.567032 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-75c6d18a-a745-4cd2-bdbd-f45421724246 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:59.571972 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-75c6d18a-a745-4cd2-bdbd-f45421724246 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 15:59:59.572562 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-75c6d18a-a745-4cd2-bdbd-f45421724246 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 15:59:59.813494 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-75c6d18a-a745-4cd2-bdbd-f45421724246 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:59.824330 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-75c6d18a-a745-4cd2-bdbd-f45421724246 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:59.836606 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-75c6d18a-a745-4cd2-bdbd-f45421724246 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 15:59:59.838269 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-75c6d18a-a745-4cd2-bdbd-f45421724246 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.296742 Jun 15 15:59:59.839632 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 477/945] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 15:59:59 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:00.858988 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-58ed4cef-70c5-48af-90b8-812b3b07574d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:00.859777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-58ed4cef-70c5-48af-90b8-812b3b07574d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:00.866310 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58ed4cef-70c5-48af-90b8-812b3b07574d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:00.866780 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58ed4cef-70c5-48af-90b8-812b3b07574d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:00.867552 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58ed4cef-70c5-48af-90b8-812b3b07574d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:00.867987 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58ed4cef-70c5-48af-90b8-812b3b07574d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:01.011872 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-58ed4cef-70c5-48af-90b8-812b3b07574d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:01.020332 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-58ed4cef-70c5-48af-90b8-812b3b07574d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:01.021842 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-58ed4cef-70c5-48af-90b8-812b3b07574d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:01.023033 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-58ed4cef-70c5-48af-90b8-812b3b07574d tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.168356 Jun 15 16:00:01.023587 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 469/946] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:00 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:02.048409 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a2152221-595f-4ec6-b2ba-87aba974182b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:02.056295 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a2152221-595f-4ec6-b2ba-87aba974182b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:02.068279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a2152221-595f-4ec6-b2ba-87aba974182b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:02.068720 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a2152221-595f-4ec6-b2ba-87aba974182b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:02.069476 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a2152221-595f-4ec6-b2ba-87aba974182b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:02.070283 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a2152221-595f-4ec6-b2ba-87aba974182b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:02.072728 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-87b800ac-acd2-4555-bf26-0946c2dc1f09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43def666-e459-41a7-b70c-24cc533462c6"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:00:02.073880 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-87b800ac-acd2-4555-bf26-0946c2dc1f09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:02.090193 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-87b800ac-acd2-4555-bf26-0946c2dc1f09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:02.090647 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-87b800ac-acd2-4555-bf26-0946c2dc1f09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:02.091635 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-87b800ac-acd2-4555-bf26-0946c2dc1f09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:02.092069 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-87b800ac-acd2-4555-bf26-0946c2dc1f09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:02.441184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a2152221-595f-4ec6-b2ba-87aba974182b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:02.450594 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a2152221-595f-4ec6-b2ba-87aba974182b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:02.453681 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a2152221-595f-4ec6-b2ba-87aba974182b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:02.455048 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a2152221-595f-4ec6-b2ba-87aba974182b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.417084 Jun 15 16:00:02.455501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 478/947] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:02 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:03.621964 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2795ff27-6f6a-46e1-9a28-5adfc45b4a7b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:03.622585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2795ff27-6f6a-46e1-9a28-5adfc45b4a7b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:03.629013 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2795ff27-6f6a-46e1-9a28-5adfc45b4a7b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:03.629463 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2795ff27-6f6a-46e1-9a28-5adfc45b4a7b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:03.630219 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2795ff27-6f6a-46e1-9a28-5adfc45b4a7b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:03.630652 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2795ff27-6f6a-46e1-9a28-5adfc45b4a7b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:03.775714 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2795ff27-6f6a-46e1-9a28-5adfc45b4a7b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:03.786055 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2795ff27-6f6a-46e1-9a28-5adfc45b4a7b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:03.787917 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2795ff27-6f6a-46e1-9a28-5adfc45b4a7b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:03.789206 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2795ff27-6f6a-46e1-9a28-5adfc45b4a7b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.321234 Jun 15 16:00:03.790084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 479/948] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:03 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 16:00:04.809255 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-70d71ac9-b813-453f-b234-cda9b41e48fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:04.810173 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-70d71ac9-b813-453f-b234-cda9b41e48fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:04.817430 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-70d71ac9-b813-453f-b234-cda9b41e48fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:04.817951 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-70d71ac9-b813-453f-b234-cda9b41e48fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:04.818832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-70d71ac9-b813-453f-b234-cda9b41e48fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:04.819337 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-70d71ac9-b813-453f-b234-cda9b41e48fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:04.960983 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-70d71ac9-b813-453f-b234-cda9b41e48fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:04.969785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-70d71ac9-b813-453f-b234-cda9b41e48fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:04.971319 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-70d71ac9-b813-453f-b234-cda9b41e48fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:04.972453 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-70d71ac9-b813-453f-b234-cda9b41e48fe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.167988 Jun 15 16:00:04.973424 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 480/949] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:04 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:05.990585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b9529c88-2a93-42c9-ab0a-b8df935ebadd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:05.991424 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b9529c88-2a93-42c9-ab0a-b8df935ebadd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:05.998683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b9529c88-2a93-42c9-ab0a-b8df935ebadd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:05.999162 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b9529c88-2a93-42c9-ab0a-b8df935ebadd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:05.999925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b9529c88-2a93-42c9-ab0a-b8df935ebadd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:06.000365 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b9529c88-2a93-42c9-ab0a-b8df935ebadd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:06.148174 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b9529c88-2a93-42c9-ab0a-b8df935ebadd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:06.158004 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b9529c88-2a93-42c9-ab0a-b8df935ebadd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:06.159822 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b9529c88-2a93-42c9-ab0a-b8df935ebadd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:06.161111 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b9529c88-2a93-42c9-ab0a-b8df935ebadd tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.174510 Jun 15 16:00:06.161753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 481/950] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:05 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 16:00:07.180967 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e7d20c79-15e7-4cb8-9f5c-7f48c614da68 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:07.181709 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e7d20c79-15e7-4cb8-9f5c-7f48c614da68 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:07.189915 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e7d20c79-15e7-4cb8-9f5c-7f48c614da68 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:07.190361 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e7d20c79-15e7-4cb8-9f5c-7f48c614da68 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:07.191176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e7d20c79-15e7-4cb8-9f5c-7f48c614da68 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:07.191606 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e7d20c79-15e7-4cb8-9f5c-7f48c614da68 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:07.328691 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e7d20c79-15e7-4cb8-9f5c-7f48c614da68 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:07.338469 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e7d20c79-15e7-4cb8-9f5c-7f48c614da68 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:07.340388 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e7d20c79-15e7-4cb8-9f5c-7f48c614da68 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:07.341892 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e7d20c79-15e7-4cb8-9f5c-7f48c614da68 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.165444 Jun 15 16:00:07.342523 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 482/951] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:07 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 16:00:08.360504 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2fe4e844-9379-4f1f-ba38-5609e4085205 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:08.361268 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2fe4e844-9379-4f1f-ba38-5609e4085205 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:08.367772 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2fe4e844-9379-4f1f-ba38-5609e4085205 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:08.368228 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2fe4e844-9379-4f1f-ba38-5609e4085205 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:08.369037 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2fe4e844-9379-4f1f-ba38-5609e4085205 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:08.369482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2fe4e844-9379-4f1f-ba38-5609e4085205 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:08.512308 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2fe4e844-9379-4f1f-ba38-5609e4085205 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:08.520674 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2fe4e844-9379-4f1f-ba38-5609e4085205 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:08.522155 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2fe4e844-9379-4f1f-ba38-5609e4085205 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:08.523314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2fe4e844-9379-4f1f-ba38-5609e4085205 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.167486 Jun 15 16:00:08.523858 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 483/952] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:08 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 16:00:09.543781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e4cd2d4c-0c7b-4fe6-9b9b-cbac5e518cd7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:09.544505 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e4cd2d4c-0c7b-4fe6-9b9b-cbac5e518cd7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:09.551573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e4cd2d4c-0c7b-4fe6-9b9b-cbac5e518cd7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:09.552028 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e4cd2d4c-0c7b-4fe6-9b9b-cbac5e518cd7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:09.552804 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e4cd2d4c-0c7b-4fe6-9b9b-cbac5e518cd7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:09.553238 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e4cd2d4c-0c7b-4fe6-9b9b-cbac5e518cd7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:09.695333 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e4cd2d4c-0c7b-4fe6-9b9b-cbac5e518cd7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:09.703763 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e4cd2d4c-0c7b-4fe6-9b9b-cbac5e518cd7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:09.705267 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e4cd2d4c-0c7b-4fe6-9b9b-cbac5e518cd7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:09.706413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e4cd2d4c-0c7b-4fe6-9b9b-cbac5e518cd7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.166909 Jun 15 16:00:09.706995 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 484/953] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:09 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 16:00:10.724547 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1d2b4b67-e20f-4ca2-8554-9caf8a3c923a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:10.725232 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1d2b4b67-e20f-4ca2-8554-9caf8a3c923a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:10.731600 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d2b4b67-e20f-4ca2-8554-9caf8a3c923a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:10.732040 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d2b4b67-e20f-4ca2-8554-9caf8a3c923a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:10.732791 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d2b4b67-e20f-4ca2-8554-9caf8a3c923a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:10.733224 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d2b4b67-e20f-4ca2-8554-9caf8a3c923a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:10.866256 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1d2b4b67-e20f-4ca2-8554-9caf8a3c923a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:10.874369 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1d2b4b67-e20f-4ca2-8554-9caf8a3c923a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:10.875956 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1d2b4b67-e20f-4ca2-8554-9caf8a3c923a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:10.877128 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1d2b4b67-e20f-4ca2-8554-9caf8a3c923a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.156459 Jun 15 16:00:10.877683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 485/954] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:10 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 16:00:11.896160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8a67002a-177d-45d7-afb9-5991b1c554ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:11.896846 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8a67002a-177d-45d7-afb9-5991b1c554ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:11.903253 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8a67002a-177d-45d7-afb9-5991b1c554ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:11.903700 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8a67002a-177d-45d7-afb9-5991b1c554ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:11.904458 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8a67002a-177d-45d7-afb9-5991b1c554ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:11.904893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8a67002a-177d-45d7-afb9-5991b1c554ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:12.045559 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8a67002a-177d-45d7-afb9-5991b1c554ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:12.053430 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8a67002a-177d-45d7-afb9-5991b1c554ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:12.054969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8a67002a-177d-45d7-afb9-5991b1c554ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:12.056245 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8a67002a-177d-45d7-afb9-5991b1c554ca tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.164596 Jun 15 16:00:12.056810 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 486/955] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:11 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 16:00:12.087538 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=25 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:00:12.205392 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:00:13.075181 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-517ce0c5-da99-47eb-bcc6-e5b2900331be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:13.075768 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-517ce0c5-da99-47eb-bcc6-e5b2900331be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:13.082948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-517ce0c5-da99-47eb-bcc6-e5b2900331be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:13.083612 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-517ce0c5-da99-47eb-bcc6-e5b2900331be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:13.084412 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-517ce0c5-da99-47eb-bcc6-e5b2900331be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:13.084946 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-517ce0c5-da99-47eb-bcc6-e5b2900331be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:13.213633 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-517ce0c5-da99-47eb-bcc6-e5b2900331be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:13.221859 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-517ce0c5-da99-47eb-bcc6-e5b2900331be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:13.223391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-517ce0c5-da99-47eb-bcc6-e5b2900331be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:13.224543 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-517ce0c5-da99-47eb-bcc6-e5b2900331be tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.153413 Jun 15 16:00:13.225151 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 487/956] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:13 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:14.244462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-89afa08a-5e86-4956-9ed0-5b3166896b0e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:14.245126 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-89afa08a-5e86-4956-9ed0-5b3166896b0e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:14.251590 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89afa08a-5e86-4956-9ed0-5b3166896b0e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:14.252072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89afa08a-5e86-4956-9ed0-5b3166896b0e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:14.253392 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89afa08a-5e86-4956-9ed0-5b3166896b0e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:14.253833 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89afa08a-5e86-4956-9ed0-5b3166896b0e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:14.388136 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-89afa08a-5e86-4956-9ed0-5b3166896b0e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:14.396114 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-89afa08a-5e86-4956-9ed0-5b3166896b0e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:14.397616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-89afa08a-5e86-4956-9ed0-5b3166896b0e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:14.398790 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-89afa08a-5e86-4956-9ed0-5b3166896b0e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.158210 Jun 15 16:00:14.399348 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 488/957] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:14 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 16:00:15.417621 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c9cdf7c5-b747-416b-90d4-3a6ae963084f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:15.418395 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c9cdf7c5-b747-416b-90d4-3a6ae963084f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:15.425333 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9cdf7c5-b747-416b-90d4-3a6ae963084f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:15.425800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9cdf7c5-b747-416b-90d4-3a6ae963084f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:15.426545 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9cdf7c5-b747-416b-90d4-3a6ae963084f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:15.426992 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c9cdf7c5-b747-416b-90d4-3a6ae963084f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:15.556693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c9cdf7c5-b747-416b-90d4-3a6ae963084f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:15.564616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c9cdf7c5-b747-416b-90d4-3a6ae963084f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:15.566119 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c9cdf7c5-b747-416b-90d4-3a6ae963084f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:15.567332 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c9cdf7c5-b747-416b-90d4-3a6ae963084f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.153624 Jun 15 16:00:15.567884 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 489/958] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:15 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 16:00:16.585829 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-af962db2-883a-4b2b-abd9-95322b77c4b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:16.586572 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-af962db2-883a-4b2b-abd9-95322b77c4b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:16.593079 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-af962db2-883a-4b2b-abd9-95322b77c4b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:16.593522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-af962db2-883a-4b2b-abd9-95322b77c4b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:16.594276 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-af962db2-883a-4b2b-abd9-95322b77c4b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:16.594707 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-af962db2-883a-4b2b-abd9-95322b77c4b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:16.725013 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-af962db2-883a-4b2b-abd9-95322b77c4b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:16.732838 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-af962db2-883a-4b2b-abd9-95322b77c4b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:16.734320 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-af962db2-883a-4b2b-abd9-95322b77c4b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:16.735493 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-af962db2-883a-4b2b-abd9-95322b77c4b4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.154093 Jun 15 16:00:16.736043 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 490/959] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:16 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 15 16:00:17.537231 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-87b800ac-acd2-4555-bf26-0946c2dc1f09 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "POST /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.469876 Jun 15 16:00:17.538274 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 470/960] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 16:00:02 2022] POST /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments => generated 194 bytes in 15472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:17.753417 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ddd1fff0-ab26-46e6-9e89-c438556ed4f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:17.754056 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ddd1fff0-ab26-46e6-9e89-c438556ed4f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:17.761543 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ddd1fff0-ab26-46e6-9e89-c438556ed4f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:17.762062 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ddd1fff0-ab26-46e6-9e89-c438556ed4f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:17.763239 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ddd1fff0-ab26-46e6-9e89-c438556ed4f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:17.763683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ddd1fff0-ab26-46e6-9e89-c438556ed4f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:17.896160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ddd1fff0-ab26-46e6-9e89-c438556ed4f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:17.904383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ddd1fff0-ab26-46e6-9e89-c438556ed4f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:17.905979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ddd1fff0-ab26-46e6-9e89-c438556ed4f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:17.907234 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ddd1fff0-ab26-46e6-9e89-c438556ed4f7 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.157786 Jun 15 16:00:17.908047 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 491/961] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:17 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:18.927673 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0d81b71f-99c6-4516-b9cd-fbfcdfeea885 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:18.928561 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0d81b71f-99c6-4516-b9cd-fbfcdfeea885 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:18.934933 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0d81b71f-99c6-4516-b9cd-fbfcdfeea885 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:18.935386 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0d81b71f-99c6-4516-b9cd-fbfcdfeea885 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:18.936205 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0d81b71f-99c6-4516-b9cd-fbfcdfeea885 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:18.936632 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0d81b71f-99c6-4516-b9cd-fbfcdfeea885 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:19.071410 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0d81b71f-99c6-4516-b9cd-fbfcdfeea885 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:19.079468 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0d81b71f-99c6-4516-b9cd-fbfcdfeea885 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:19.080964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0d81b71f-99c6-4516-b9cd-fbfcdfeea885 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:19.082527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0d81b71f-99c6-4516-b9cd-fbfcdfeea885 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.159959 Jun 15 16:00:19.083310 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 471/962] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:18 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:20.101244 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-86837805-f3de-47e2-ae97-48acdf412668 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:20.101843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-86837805-f3de-47e2-ae97-48acdf412668 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:20.108549 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-86837805-f3de-47e2-ae97-48acdf412668 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:20.108993 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-86837805-f3de-47e2-ae97-48acdf412668 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:20.109745 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-86837805-f3de-47e2-ae97-48acdf412668 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:20.110171 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-86837805-f3de-47e2-ae97-48acdf412668 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:20.235396 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-86837805-f3de-47e2-ae97-48acdf412668 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:20.243286 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-86837805-f3de-47e2-ae97-48acdf412668 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:20.244795 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-86837805-f3de-47e2-ae97-48acdf412668 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:20.245948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-86837805-f3de-47e2-ae97-48acdf412668 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.149328 Jun 15 16:00:20.246505 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 492/963] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:20 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:20.362824 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-d43e25f1-0142-49ff-a978-0d35866cd6f7 req-55887649-8458-41aa-b063-86ecabfef3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c4bb33d-2d9f-4620-9e94-f28e12cd604f", "name": "network-vif-plugged", "status": "completed", "tag": "6153ea23-abc5-46cb-96ff-6597e6888d85"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:00:20.371298 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-d43e25f1-0142-49ff-a978-0d35866cd6f7 req-55887649-8458-41aa-b063-86ecabfef3a7 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:20.371742 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-d43e25f1-0142-49ff-a978-0d35866cd6f7 req-55887649-8458-41aa-b063-86ecabfef3a7 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:20.383545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-d43e25f1-0142-49ff-a978-0d35866cd6f7 req-55887649-8458-41aa-b063-86ecabfef3a7 service nova] Creating event network-vif-plugged:6153ea23-abc5-46cb-96ff-6597e6888d85 for instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f on hv-cinder-84599 Jun 15 16:00:20.388215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-d43e25f1-0142-49ff-a978-0d35866cd6f7 req-55887649-8458-41aa-b063-86ecabfef3a7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029165 Jun 15 16:00:20.388960 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 472/964] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:21.263938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-95c814e0-93ac-46a8-bd00-664713fe853e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:21.264572 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-95c814e0-93ac-46a8-bd00-664713fe853e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:21.271108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95c814e0-93ac-46a8-bd00-664713fe853e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:21.271556 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95c814e0-93ac-46a8-bd00-664713fe853e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:21.272323 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95c814e0-93ac-46a8-bd00-664713fe853e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:21.272760 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-95c814e0-93ac-46a8-bd00-664713fe853e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:21.275324 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:00:21.397965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-95c814e0-93ac-46a8-bd00-664713fe853e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:21.405852 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-95c814e0-93ac-46a8-bd00-664713fe853e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:21.407372 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-95c814e0-93ac-46a8-bd00-664713fe853e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:21.408768 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-95c814e0-93ac-46a8-bd00-664713fe853e tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.148774 Jun 15 16:00:21.409310 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 493/965] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:21 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:22.428953 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-11002b43-cea9-4df0-ab95-28f2283ea112 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:22.429731 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-11002b43-cea9-4df0-ab95-28f2283ea112 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:22.436118 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-11002b43-cea9-4df0-ab95-28f2283ea112 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:22.436571 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-11002b43-cea9-4df0-ab95-28f2283ea112 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:22.437342 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-11002b43-cea9-4df0-ab95-28f2283ea112 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:22.437784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-11002b43-cea9-4df0-ab95-28f2283ea112 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:22.567006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-11002b43-cea9-4df0-ab95-28f2283ea112 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:22.575098 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-11002b43-cea9-4df0-ab95-28f2283ea112 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:22.576606 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-11002b43-cea9-4df0-ab95-28f2283ea112 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:22.577765 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-11002b43-cea9-4df0-ab95-28f2283ea112 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.154095 Jun 15 16:00:22.578319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 473/966] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:22 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:23.595617 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-96cfc757-a8e9-487a-b6b7-f331e454a9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:23.596221 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-96cfc757-a8e9-487a-b6b7-f331e454a9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:23.603175 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-96cfc757-a8e9-487a-b6b7-f331e454a9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:23.603658 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-96cfc757-a8e9-487a-b6b7-f331e454a9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:23.604451 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-96cfc757-a8e9-487a-b6b7-f331e454a9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:23.604888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-96cfc757-a8e9-487a-b6b7-f331e454a9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:23.743871 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-96cfc757-a8e9-487a-b6b7-f331e454a9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:23.752549 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-96cfc757-a8e9-487a-b6b7-f331e454a9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:23.754304 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-96cfc757-a8e9-487a-b6b7-f331e454a9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:23.756004 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-96cfc757-a8e9-487a-b6b7-f331e454a9c4 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.164062 Jun 15 16:00:23.756560 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 494/967] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:23 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:24.773258 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a6c032dc-fd83-4b80-97ec-84f661051428 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:24.773867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a6c032dc-fd83-4b80-97ec-84f661051428 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:24.780422 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a6c032dc-fd83-4b80-97ec-84f661051428 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:24.780871 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a6c032dc-fd83-4b80-97ec-84f661051428 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:24.781639 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a6c032dc-fd83-4b80-97ec-84f661051428 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:24.782070 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a6c032dc-fd83-4b80-97ec-84f661051428 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:24.926495 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a6c032dc-fd83-4b80-97ec-84f661051428 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:24.935173 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a6c032dc-fd83-4b80-97ec-84f661051428 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:24.936679 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a6c032dc-fd83-4b80-97ec-84f661051428 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:24.937830 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a6c032dc-fd83-4b80-97ec-84f661051428 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1731 microversion: 2.20 time: 0.168462 Jun 15 16:00:24.938382 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 474/968] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:24 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:25.955657 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-500e43bb-2274-43b4-bd18-d501c5c5bdfe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:25.956287 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-500e43bb-2274-43b4-bd18-d501c5c5bdfe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:25.962818 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-500e43bb-2274-43b4-bd18-d501c5c5bdfe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:25.963231 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-500e43bb-2274-43b4-bd18-d501c5c5bdfe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:25.963986 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-500e43bb-2274-43b4-bd18-d501c5c5bdfe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:25.964420 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-500e43bb-2274-43b4-bd18-d501c5c5bdfe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:26.084304 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1f9c2142-e943-4923-8a4e-f75d631f01c7 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:26.085107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1f9c2142-e943-4923-8a4e-f75d631f01c7 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:26.091814 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1f9c2142-e943-4923-8a4e-f75d631f01c7 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:26.092272 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1f9c2142-e943-4923-8a4e-f75d631f01c7 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:26.093050 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1f9c2142-e943-4923-8a4e-f75d631f01c7 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:26.093496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1f9c2142-e943-4923-8a4e-f75d631f01c7 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:26.095754 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-500e43bb-2274-43b4-bd18-d501c5c5bdfe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:26.104383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-500e43bb-2274-43b4-bd18-d501c5c5bdfe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:26.105888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-500e43bb-2274-43b4-bd18-d501c5c5bdfe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:26.107116 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-500e43bb-2274-43b4-bd18-d501c5c5bdfe tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1718 microversion: 2.20 time: 0.155302 Jun 15 16:00:26.109392 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 495/969] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:00:25 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:00:26.126869 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1f9c2142-e943-4923-8a4e-f75d631f01c7 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047111 Jun 15 16:00:26.127428 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 475/970] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 16:00:26 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:26.268276 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2e9a6eca-2f82-4cfc-9375-10aca2573904 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:26.268719 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2e9a6eca-2f82-4cfc-9375-10aca2573904 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:26.275269 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2e9a6eca-2f82-4cfc-9375-10aca2573904 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:26.275709 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2e9a6eca-2f82-4cfc-9375-10aca2573904 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:26.276489 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2e9a6eca-2f82-4cfc-9375-10aca2573904 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:26.276921 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2e9a6eca-2f82-4cfc-9375-10aca2573904 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:26.307290 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2e9a6eca-2f82-4cfc-9375-10aca2573904 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments/609d877c-3ba6-4552-9b4e-7aef999d3675" status: 200 len: 194 microversion: 2.1 time: 0.043041 Jun 15 16:00:26.307854 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 496/971] 10.222.0.62 () {58 vars in 1412 bytes} [Wed Jun 15 16:00:26 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments/609d877c-3ba6-4552-9b4e-7aef999d3675 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:26.317443 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-21c20f6c-e358-4e8c-ab7a-589771aee6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:26.317928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-21c20f6c-e358-4e8c-ab7a-589771aee6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:26.323958 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21c20f6c-e358-4e8c-ab7a-589771aee6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:26.324398 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21c20f6c-e358-4e8c-ab7a-589771aee6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:26.325147 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21c20f6c-e358-4e8c-ab7a-589771aee6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:26.325697 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-21c20f6c-e358-4e8c-ab7a-589771aee6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:26.404187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-21c20f6c-e358-4e8c-ab7a-589771aee6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lazy-loading 'services' on Instance uuid e3e47f87-a115-44d0-93d9-3181aa6f631e {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:00:26.474820 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-21c20f6c-e358-4e8c-ab7a-589771aee6b6 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments/609d877c-3ba6-4552-9b4e-7aef999d3675" status: 202 len: 0 microversion: 2.1 time: 0.161042 Jun 15 16:00:26.475414 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 476/972] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 16:00:26 2022] DELETE /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments/609d877c-3ba6-4552-9b4e-7aef999d3675 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:00:28.639795 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0562ff8e-d540-4c9b-b73a-bb0f2001cb48 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:28.640290 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0562ff8e-d540-4c9b-b73a-bb0f2001cb48 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:28.642718 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=44 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:00:28.648256 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0562ff8e-d540-4c9b-b73a-bb0f2001cb48 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:28.648703 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0562ff8e-d540-4c9b-b73a-bb0f2001cb48 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:28.649459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0562ff8e-d540-4c9b-b73a-bb0f2001cb48 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:28.649924 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0562ff8e-d540-4c9b-b73a-bb0f2001cb48 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:28.678169 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0562ff8e-d540-4c9b-b73a-bb0f2001cb48 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments/43def666-e459-41a7-b70c-24cc533462c6" status: 200 len: 194 microversion: 2.1 time: 0.042249 Jun 15 16:00:28.678809 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 497/973] 10.222.0.62 () {58 vars in 1412 bytes} [Wed Jun 15 16:00:28 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments/43def666-e459-41a7-b70c-24cc533462c6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:28.689076 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ad3392fc-be70-43bc-b97e-6714a35d8ee3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:28.689658 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ad3392fc-be70-43bc-b97e-6714a35d8ee3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:28.696910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ad3392fc-be70-43bc-b97e-6714a35d8ee3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:28.697363 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ad3392fc-be70-43bc-b97e-6714a35d8ee3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:28.698127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ad3392fc-be70-43bc-b97e-6714a35d8ee3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:28.698565 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ad3392fc-be70-43bc-b97e-6714a35d8ee3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:28.778658 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-ad3392fc-be70-43bc-b97e-6714a35d8ee3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lazy-loading 'services' on Instance uuid e3e47f87-a115-44d0-93d9-3181aa6f631e {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:00:28.847660 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ad3392fc-be70-43bc-b97e-6714a35d8ee3 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments/43def666-e459-41a7-b70c-24cc533462c6" status: 202 len: 0 microversion: 2.1 time: 0.162730 Jun 15 16:00:28.848239 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 477/974] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 16:00:28 2022] DELETE /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments/43def666-e459-41a7-b70c-24cc533462c6 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 15 16:00:30.002569 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-fc965e2a-3abe-4776-8ba1-82b227d2cc7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:30.003593 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-fc965e2a-3abe-4776-8ba1-82b227d2cc7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:30.009757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fc965e2a-3abe-4776-8ba1-82b227d2cc7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:30.010199 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fc965e2a-3abe-4776-8ba1-82b227d2cc7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:30.010981 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fc965e2a-3abe-4776-8ba1-82b227d2cc7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:30.011407 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fc965e2a-3abe-4776-8ba1-82b227d2cc7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:30.041096 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fc965e2a-3abe-4776-8ba1-82b227d2cc7c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042377 Jun 15 16:00:30.041639 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 498/975] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 16:00:29 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 16:00:30.150027 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-dbc7a9ca-6bcd-4597-8d61-d6c85c2bee77 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:30.151131 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-dbc7a9ca-6bcd-4597-8d61-d6c85c2bee77 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:30.157784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbc7a9ca-6bcd-4597-8d61-d6c85c2bee77 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:30.158584 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbc7a9ca-6bcd-4597-8d61-d6c85c2bee77 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:30.159462 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbc7a9ca-6bcd-4597-8d61-d6c85c2bee77 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:30.159903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbc7a9ca-6bcd-4597-8d61-d6c85c2bee77 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:30.188498 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-dbc7a9ca-6bcd-4597-8d61-d6c85c2bee77 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043921 Jun 15 16:00:30.189045 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 478/976] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 16:00:30 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 16:00:30.246308 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-22222fe2-c5ea-49ea-b1b8-10ca5e8f83cb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:30.246845 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-22222fe2-c5ea-49ea-b1b8-10ca5e8f83cb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:30.252814 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-22222fe2-c5ea-49ea-b1b8-10ca5e8f83cb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:30.253268 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-22222fe2-c5ea-49ea-b1b8-10ca5e8f83cb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:30.254028 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-22222fe2-c5ea-49ea-b1b8-10ca5e8f83cb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:30.254463 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-22222fe2-c5ea-49ea-b1b8-10ca5e8f83cb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:30.279391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-22222fe2-c5ea-49ea-b1b8-10ca5e8f83cb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Going to try to terminate instance {{(pid=123934) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 16:00:30.354660 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-22222fe2-c5ea-49ea-b1b8-10ca5e8f83cb tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 204 len: 0 microversion: 2.1 time: 0.112159 Jun 15 16:00:30.355317 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 499/977] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:00:30 2022] DELETE /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 16:00:30.364430 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-593cdd50-66ab-4bbd-9a68-30b08f519eb9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:30.365046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-593cdd50-66ab-4bbd-9a68-30b08f519eb9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:30.371330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-593cdd50-66ab-4bbd-9a68-30b08f519eb9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:30.371784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-593cdd50-66ab-4bbd-9a68-30b08f519eb9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:30.372544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-593cdd50-66ab-4bbd-9a68-30b08f519eb9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:30.372981 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-593cdd50-66ab-4bbd-9a68-30b08f519eb9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:30.500822 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-593cdd50-66ab-4bbd-9a68-30b08f519eb9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:30.508991 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-593cdd50-66ab-4bbd-9a68-30b08f519eb9 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1674 microversion: 2.1 time: 0.149313 Jun 15 16:00:30.509561 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 479/978] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:00:30 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:00:31.526644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ccf70ded-ac90-4e00-9e30-404bc63b8b7a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:31.527452 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ccf70ded-ac90-4e00-9e30-404bc63b8b7a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:31.534156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ccf70ded-ac90-4e00-9e30-404bc63b8b7a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:31.534597 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ccf70ded-ac90-4e00-9e30-404bc63b8b7a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:31.535378 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ccf70ded-ac90-4e00-9e30-404bc63b8b7a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:31.535800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ccf70ded-ac90-4e00-9e30-404bc63b8b7a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:31.667869 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ccf70ded-ac90-4e00-9e30-404bc63b8b7a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:31.675329 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ccf70ded-ac90-4e00-9e30-404bc63b8b7a tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1674 microversion: 2.1 time: 0.152879 Jun 15 16:00:31.675890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 500/979] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:00:31 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:00:32.692646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-217f5241-de2b-4afa-bc81-e3e54b0671c5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:32.693280 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-217f5241-de2b-4afa-bc81-e3e54b0671c5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:32.699833 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-217f5241-de2b-4afa-bc81-e3e54b0671c5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:32.700265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-217f5241-de2b-4afa-bc81-e3e54b0671c5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:32.701023 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-217f5241-de2b-4afa-bc81-e3e54b0671c5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:32.701452 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-217f5241-de2b-4afa-bc81-e3e54b0671c5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:32.833795 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-217f5241-de2b-4afa-bc81-e3e54b0671c5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:32.841788 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-217f5241-de2b-4afa-bc81-e3e54b0671c5 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1674 microversion: 2.1 time: 0.153002 Jun 15 16:00:32.842348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 480/980] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:00:32 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:00:33.863026 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c6df8aa4-45db-425f-b523-fa347fb01367 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:33.863636 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c6df8aa4-45db-425f-b523-fa347fb01367 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:33.871238 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c6df8aa4-45db-425f-b523-fa347fb01367 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:33.871686 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c6df8aa4-45db-425f-b523-fa347fb01367 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:33.872459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c6df8aa4-45db-425f-b523-fa347fb01367 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:33.872896 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c6df8aa4-45db-425f-b523-fa347fb01367 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:33.947135 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c6df8aa4-45db-425f-b523-fa347fb01367 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:33.954837 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c6df8aa4-45db-425f-b523-fa347fb01367 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1606 microversion: 2.1 time: 0.098408 Jun 15 16:00:33.955790 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 501/981] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:00:33 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1606 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:00:34.122098 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-b8fbbfb8-e56e-4d4b-8d92-9633a3c53320 req-fab6b561-c39f-4837-aee0-174579c195c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e47f87-a115-44d0-93d9-3181aa6f631e", "name": "network-vif-deleted", "tag": "8570634e-e484-40f9-b3b3-3edbfe2fe2bc"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:00:34.133391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-b8fbbfb8-e56e-4d4b-8d92-9633a3c53320 req-fab6b561-c39f-4837-aee0-174579c195c2 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:34.133836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-b8fbbfb8-e56e-4d4b-8d92-9633a3c53320 req-fab6b561-c39f-4837-aee0-174579c195c2 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:34.145898 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-b8fbbfb8-e56e-4d4b-8d92-9633a3c53320 req-fab6b561-c39f-4837-aee0-174579c195c2 service nova] Creating event network-vif-deleted:8570634e-e484-40f9-b3b3-3edbfe2fe2bc for instance e3e47f87-a115-44d0-93d9-3181aa6f631e on hv-cinder-84599 Jun 15 16:00:34.151361 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-b8fbbfb8-e56e-4d4b-8d92-9633a3c53320 req-fab6b561-c39f-4837-aee0-174579c195c2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032947 Jun 15 16:00:34.152011 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 481/982] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:34.972763 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4d814f41-2fb0-43d1-9909-6ae63fdd5466 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:34.973369 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4d814f41-2fb0-43d1-9909-6ae63fdd5466 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:34.980603 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4d814f41-2fb0-43d1-9909-6ae63fdd5466 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:34.981079 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4d814f41-2fb0-43d1-9909-6ae63fdd5466 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:34.981854 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4d814f41-2fb0-43d1-9909-6ae63fdd5466 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:34.982284 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4d814f41-2fb0-43d1-9909-6ae63fdd5466 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:35.012922 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4d814f41-2fb0-43d1-9909-6ae63fdd5466 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:35.013371 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4d814f41-2fb0-43d1-9909-6ae63fdd5466 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:35.013812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-4d814f41-2fb0-43d1-9909-6ae63fdd5466 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lazy-loading 'fault' on Instance uuid e3e47f87-a115-44d0-93d9-3181aa6f631e {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:00:35.054120 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4d814f41-2fb0-43d1-9909-6ae63fdd5466 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:35.061499 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4d814f41-2fb0-43d1-9909-6ae63fdd5466 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1327 microversion: 2.1 time: 0.092714 Jun 15 16:00:35.062061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 502/983] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:00:34 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1327 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:00:36.078455 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a391fb28-afcc-4da7-90ae-adc1c6c95989 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:36.079190 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a391fb28-afcc-4da7-90ae-adc1c6c95989 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:36.085917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a391fb28-afcc-4da7-90ae-adc1c6c95989 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:36.086369 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a391fb28-afcc-4da7-90ae-adc1c6c95989 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:36.087175 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a391fb28-afcc-4da7-90ae-adc1c6c95989 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:36.087616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a391fb28-afcc-4da7-90ae-adc1c6c95989 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:36.119151 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a391fb28-afcc-4da7-90ae-adc1c6c95989 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:36.119599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a391fb28-afcc-4da7-90ae-adc1c6c95989 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:36.120048 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-a391fb28-afcc-4da7-90ae-adc1c6c95989 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lazy-loading 'fault' on Instance uuid e3e47f87-a115-44d0-93d9-3181aa6f631e {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:00:36.165439 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a391fb28-afcc-4da7-90ae-adc1c6c95989 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:36.172921 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a391fb28-afcc-4da7-90ae-adc1c6c95989 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1327 microversion: 2.1 time: 0.098689 Jun 15 16:00:36.173517 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 482/984] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:00:36 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:00:37.190131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1dfb4289-05d2-4870-9b7e-7b8bf8427b1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:37.190757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1dfb4289-05d2-4870-9b7e-7b8bf8427b1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:37.197971 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1dfb4289-05d2-4870-9b7e-7b8bf8427b1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:37.198415 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1dfb4289-05d2-4870-9b7e-7b8bf8427b1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:37.199207 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1dfb4289-05d2-4870-9b7e-7b8bf8427b1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:37.199643 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1dfb4289-05d2-4870-9b7e-7b8bf8427b1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:37.232414 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1dfb4289-05d2-4870-9b7e-7b8bf8427b1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:37.232790 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1dfb4289-05d2-4870-9b7e-7b8bf8427b1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:37.233230 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-1dfb4289-05d2-4870-9b7e-7b8bf8427b1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lazy-loading 'fault' on Instance uuid e3e47f87-a115-44d0-93d9-3181aa6f631e {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:00:37.272750 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1dfb4289-05d2-4870-9b7e-7b8bf8427b1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434c81b82dee404f8d143f1bdf56d3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669dc76c39b3427b8c55fd47de62595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:00:37.280084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1dfb4289-05d2-4870-9b7e-7b8bf8427b1c tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 200 len: 1327 microversion: 2.1 time: 0.093909 Jun 15 16:00:37.280660 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 503/985] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:00:37 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:00:38.297496 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7ca2b5c3-5437-4a62-8954-005890546abd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:38.298014 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7ca2b5c3-5437-4a62-8954-005890546abd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:38.305114 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7ca2b5c3-5437-4a62-8954-005890546abd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:38.305573 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7ca2b5c3-5437-4a62-8954-005890546abd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:38.306393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7ca2b5c3-5437-4a62-8954-005890546abd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:38.306865 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7ca2b5c3-5437-4a62-8954-005890546abd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:38.320825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-7ca2b5c3-5437-4a62-8954-005890546abd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] HTTP exception thrown: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7ca2b5c3-5437-4a62-8954-005890546abd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Request method failure captured: Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e HTTP/1.1 Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-mlqOr39MFRHDxJwpOEApB2zneCqHrPlwXdC9EHztaF_cJxqGM4gPtnOm7pHDBJ6mXBqh9I07hcjPauXPUE4JdLH5gOZ9TZOqsoQMy_Dq1i1tADcxNwh92cdeS30mMSoGJwilokLVnaS3S5ECOPldXwX3-e6bOVbHs6pyblAmP700 Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:00:38.322512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_669dc76c39b3427b8c55fd47de62595f", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 434c81b82dee404f8d143f1bdf56d3ca Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:38.324285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'e3e47f87-a115-44d0-93d9-3181aa6f631e'} Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:00:38.325195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:38.327106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:38.328659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7ca2b5c3-5437-4a62-8954-005890546abd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Returning 404 to user: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:00:38.328659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7ca2b5c3-5437-4a62-8954-005890546abd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 404 len: 111 microversion: 2.1 time: 0.030466 Jun 15 16:00:38.328659 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 483/986] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:00:38 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:00:38.334628 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2ee586ad-3bd8-4570-b48c-e8d05325c1fc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '.version_select at 0x7fd8dc1e45e0>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:38.351952 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2ee586ad-3bd8-4570-b48c-e8d05325c1fc tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096012584" status: 202 len: 0 microversion: 2.1 time: 0.021838 Jun 15 16:00:38.352492 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 504/987] 10.222.0.62 () {58 vars in 1220 bytes} [Wed Jun 15 16:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096012584 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:00:41.455346 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-05bbdbff-0440-4946-a886-bc72f90ebf40 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:41.455845 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-05bbdbff-0440-4946-a886-bc72f90ebf40 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:41.463206 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05bbdbff-0440-4946-a886-bc72f90ebf40 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:41.463664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05bbdbff-0440-4946-a886-bc72f90ebf40 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:41.464434 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05bbdbff-0440-4946-a886-bc72f90ebf40 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:41.464878 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-05bbdbff-0440-4946-a886-bc72f90ebf40 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:41.479158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-05bbdbff-0440-4946-a886-bc72f90ebf40 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] HTTP exception thrown: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-05bbdbff-0440-4946-a886-bc72f90ebf40 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Request method failure captured: Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: DELETE /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e HTTP/1.1 Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-mlqOr39MFRHDxJwpOEApB2zneCqHrPlwXdC9EHztaF_cJxqGM4gPtnOm7pHDBJ6mXBqh9I07hcjPauXPUE4JdLH5gOZ9TZOqsoQMy_Dq1i1tADcxNwh92cdeS30mMSoGJwilokLVnaS3S5ECOPldXwX3-e6bOVbHs6pyblAmP700 Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:00:41.480732 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_669dc76c39b3427b8c55fd47de62595f", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 434c81b82dee404f8d143f1bdf56d3ca Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:41.482270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'e3e47f87-a115-44d0-93d9-3181aa6f631e'} Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:00:41.486367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:41.487693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:41.488922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-05bbdbff-0440-4946-a886-bc72f90ebf40 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Returning 404 to user: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:00:41.488922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-05bbdbff-0440-4946-a886-bc72f90ebf40 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 404 len: 111 microversion: 2.1 time: 0.030676 Jun 15 16:00:41.488922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 484/988] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:00:41 2022] DELETE /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:00:41.491576 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-33be2cb5-5157-48ee-be08-319de4002f67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:41.492395 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-33be2cb5-5157-48ee-be08-319de4002f67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: e3e47f87-a115-44d0-93d9-3181aa6f631e] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:41.499665 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33be2cb5-5157-48ee-be08-319de4002f67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:41.500130 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33be2cb5-5157-48ee-be08-319de4002f67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:41.500933 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33be2cb5-5157-48ee-be08-319de4002f67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:41.501362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-33be2cb5-5157-48ee-be08-319de4002f67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:41.514995 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-33be2cb5-5157-48ee-be08-319de4002f67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] HTTP exception thrown: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-33be2cb5-5157-48ee-be08-319de4002f67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Request method failure captured: Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e HTTP/1.1 Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-mlqOr39MFRHDxJwpOEApB2zneCqHrPlwXdC9EHztaF_cJxqGM4gPtnOm7pHDBJ6mXBqh9I07hcjPauXPUE4JdLH5gOZ9TZOqsoQMy_Dq1i1tADcxNwh92cdeS30mMSoGJwilokLVnaS3S5ECOPldXwX3-e6bOVbHs6pyblAmP700 Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:00:41.516618 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_669dc76c39b3427b8c55fd47de62595f", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 434c81b82dee404f8d143f1bdf56d3ca Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:41.518158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': 'e3e47f87-a115-44d0-93d9-3181aa6f631e'} Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:00:41.519540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. Jun 15 16:00:41.521108 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:41.522868 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-33be2cb5-5157-48ee-be08-319de4002f67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Returning 404 to user: Instance e3e47f87-a115-44d0-93d9-3181aa6f631e could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:00:41.522868 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-33be2cb5-5157-48ee-be08-319de4002f67 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e" status: 404 len: 111 microversion: 2.1 time: 0.031206 Jun 15 16:00:41.522868 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 505/989] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:00:41 2022] GET /compute/v2.1/servers/e3e47f87-a115-44d0-93d9-3181aa6f631e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:00:42.655523 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4da07811-ecad-4cb3-af4f-ffd64a3e1bdd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:42.656032 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4da07811-ecad-4cb3-af4f-ffd64a3e1bdd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:42.658402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=31 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:00:42.664494 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4da07811-ecad-4cb3-af4f-ffd64a3e1bdd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:42.664950 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4da07811-ecad-4cb3-af4f-ffd64a3e1bdd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:42.665814 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4da07811-ecad-4cb3-af4f-ffd64a3e1bdd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:42.666252 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4da07811-ecad-4cb3-af4f-ffd64a3e1bdd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:42.670289 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:00:42.681096 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-4da07811-ecad-4cb3-af4f-ffd64a3e1bdd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] HTTP exception thrown: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4da07811-ecad-4cb3-af4f-ffd64a3e1bdd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Request method failure captured: Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: DELETE /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 HTTP/1.1 Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-mlqOr39MFRHDxJwpOEApB2zneCqHrPlwXdC9EHztaF_cJxqGM4gPtnOm7pHDBJ6mXBqh9I07hcjPauXPUE4JdLH5gOZ9TZOqsoQMy_Dq1i1tADcxNwh92cdeS30mMSoGJwilokLVnaS3S5ECOPldXwX3-e6bOVbHs6pyblAmP700 Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:00:42.682646 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_669dc76c39b3427b8c55fd47de62595f", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 434c81b82dee404f8d143f1bdf56d3ca Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 16:00:42.683964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': '9e67259e-9dd3-4875-9185-fa11291a54d9'} Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:00:42.684690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 16:00:42.686049 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:42.687516 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4da07811-ecad-4cb3-af4f-ffd64a3e1bdd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Returning 404 to user: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:00:42.687516 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4da07811-ecad-4cb3-af4f-ffd64a3e1bdd tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 404 len: 111 microversion: 2.1 time: 0.032492 Jun 15 16:00:42.687516 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 485/990] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:00:42 2022] DELETE /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:00:42.692607 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1e56d657-bda9-47b0-9325-ac1b4e8c5f47 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:42.693212 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1e56d657-bda9-47b0-9325-ac1b4e8c5f47 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] [instance: 9e67259e-9dd3-4875-9185-fa11291a54d9] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:00:42.700271 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1e56d657-bda9-47b0-9325-ac1b4e8c5f47 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:42.700790 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1e56d657-bda9-47b0-9325-ac1b4e8c5f47 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:42.701496 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1e56d657-bda9-47b0-9325-ac1b4e8c5f47 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:00:42.701925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1e56d657-bda9-47b0-9325-ac1b4e8c5f47 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:00:42.714914 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-1e56d657-bda9-47b0-9325-ac1b4e8c5f47 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] HTTP exception thrown: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1e56d657-bda9-47b0-9325-ac1b4e8c5f47 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Request method failure captured: Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 HTTP/1.1 Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-mlqOr39MFRHDxJwpOEApB2zneCqHrPlwXdC9EHztaF_cJxqGM4gPtnOm7pHDBJ6mXBqh9I07hcjPauXPUE4JdLH5gOZ9TZOqsoQMy_Dq1i1tADcxNwh92cdeS30mMSoGJwilokLVnaS3S5ECOPldXwX3-e6bOVbHs6pyblAmP700 Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:00:42.716403 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/669dc76c39b3427b8c55fd47de62595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_669dc76c39b3427b8c55fd47de62595f", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 669dc76c39b3427b8c55fd47de62595f Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1833433233 Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 434c81b82dee404f8d143f1bdf56d3ca Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeTestJSON-1833433233-project Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 16:00:42.717965 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '9e67259e-9dd3-4875-9185-fa11291a54d9'} Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:00:42.718938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. Jun 15 16:00:42.720368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:42.721660 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1e56d657-bda9-47b0-9325-ac1b4e8c5f47 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] Returning 404 to user: Instance 9e67259e-9dd3-4875-9185-fa11291a54d9 could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:00:42.721660 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1e56d657-bda9-47b0-9325-ac1b4e8c5f47 tempest-AttachVolumeTestJSON-1833433233 tempest-AttachVolumeTestJSON-1833433233-project] 10.222.0.62 "GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9" status: 404 len: 111 microversion: 2.1 time: 0.029023 Jun 15 16:00:42.721660 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 506/991] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:00:42 2022] GET /compute/v2.1/servers/9e67259e-9dd3-4875-9185-fa11291a54d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:00:47.064558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-45eaba01-8196-421e-a2cf-5dccec6f3a96 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Action: 'create', calling method: .version_select at 0x7fd8d80a0d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1907380026"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:00:47.347044 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-45eaba01-8196-421e-a2cf-5dccec6f3a96 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.429696 Jun 15 16:00:47.347784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 486/992] 10.222.0.62 () {60 vars in 1154 bytes} [Wed Jun 15 16:00:46 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 431 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 15 16:00:47.359116 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6dc464db-bc5f-472e-83f6-70e9194489d4 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8dc0c8d30>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:47.409638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6dc464db-bc5f-472e-83f6-70e9194489d4 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea" status: 200 len: 345 microversion: 2.1 time: 0.053894 Jun 15 16:00:47.410281 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 507/993] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 16:00:47 2022] GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:48.422866 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d0764e66-ca10-4430-a2b0-a4e82afa50ef tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8d37998b0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:48.472833 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d0764e66-ca10-4430-a2b0-a4e82afa50ef tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea" status: 200 len: 346 microversion: 2.1 time: 0.054235 Jun 15 16:00:48.473402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 487/994] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 16:00:48 2022] GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:48.485391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-aea4ba8c-a491-4dd5-95ae-7d72ae931b3b tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Action: 'create', calling method: .version_select at 0x7fd8d85eeca0>, body: {"snapshot": {"volume_id": "48431a4b-23af-44e6-9c16-2fc0f6fb31ea", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1359947294"}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:00:48.639492 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-aea4ba8c-a491-4dd5-95ae-7d72ae931b3b tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.158226 Jun 15 16:00:48.640119 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 508/995] 10.222.0.62 () {60 vars in 1161 bytes} [Wed Jun 15 16:00:48 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:48.650993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c4b869ed-4839-473e-a8ad-5476530a2afc tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8d80a0310>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:48.683485 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c4b869ed-4839-473e-a8ad-5476530a2afc tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d" status: 200 len: 287 microversion: 2.1 time: 0.036263 Jun 15 16:00:48.684217 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 488/996] 10.222.0.62 () {58 vars in 1250 bytes} [Wed Jun 15 16:00:48 2022] GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:48.694145 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a77fd1f1-31dc-4b84-a0ff-e114e815fee0 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8dc0c8d30>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:48.722450 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a77fd1f1-31dc-4b84-a0ff-e114e815fee0 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032199 Jun 15 16:00:48.723028 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 509/997] 10.222.0.62 () {58 vars in 1139 bytes} [Wed Jun 15 16:00:48 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:48.733952 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ede11e6c-4690-4bfa-a17d-0f3dc0856be0 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8d81b84c0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:48.762867 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ede11e6c-4690-4bfa-a17d-0f3dc0856be0 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d" status: 200 len: 287 microversion: 2.1 time: 0.033148 Jun 15 16:00:48.763431 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 489/998] 10.222.0.62 () {58 vars in 1250 bytes} [Wed Jun 15 16:00:48 2022] GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:49.775505 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2997da2a-a31f-439a-8a67-4c1fa631e4f5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8dc1210d0>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:49.804945 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2997da2a-a31f-439a-8a67-4c1fa631e4f5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d" status: 200 len: 287 microversion: 2.1 time: 0.033724 Jun 15 16:00:49.805503 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 510/999] 10.222.0.62 () {58 vars in 1250 bytes} [Wed Jun 15 16:00:49 2022] GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:50.817231 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c1ff5a3e-759d-42a6-a4ef-52c4f51683d2 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8d37ee9d0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:50.847753 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c1ff5a3e-759d-42a6-a4ef-52c4f51683d2 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d" status: 200 len: 287 microversion: 2.1 time: 0.034778 Jun 15 16:00:50.848314 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 490/1000] 10.222.0.62 () {58 vars in 1250 bytes} [Wed Jun 15 16:00:50 2022] GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:51.859975 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9b86e32b-9782-41d0-8d15-4f0f79448d7b tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8dc06e040>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:51.889705 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9b86e32b-9782-41d0-8d15-4f0f79448d7b tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d" status: 200 len: 287 microversion: 2.1 time: 0.034214 Jun 15 16:00:51.890256 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 511/1001] 10.222.0.62 () {58 vars in 1250 bytes} [Wed Jun 15 16:00:51 2022] GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:52.899180 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:00:52.903271 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-45b62ddc-65fa-4d1a-a3f5-a2e73f111459 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8d8293310>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:52.935572 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-45b62ddc-65fa-4d1a-a3f5-a2e73f111459 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d" status: 200 len: 288 microversion: 2.1 time: 0.037502 Jun 15 16:00:52.936184 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 491/1002] 10.222.0.62 () {58 vars in 1250 bytes} [Wed Jun 15 16:00:52 2022] GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:52.943655 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:00:52.944636 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:00:52.949391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2f6447ff-6980-4b2c-ba6b-a677fb784dc7 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8dc1214c0>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:53.004999 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2f6447ff-6980-4b2c-ba6b-a677fb784dc7 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d" status: 202 len: 0 microversion: 2.1 time: 0.062113 Jun 15 16:00:53.005626 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 512/1003] 10.222.0.62 () {58 vars in 1253 bytes} [Wed Jun 15 16:00:52 2022] DELETE /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:00:53.014289 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-907188d4-efdc-4a01-b23a-a4417c376359 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8d8293550>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:53.044235 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-907188d4-efdc-4a01-b23a-a4417c376359 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d" status: 200 len: 287 microversion: 2.1 time: 0.033541 Jun 15 16:00:53.044804 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 492/1004] 10.222.0.62 () {58 vars in 1250 bytes} [Wed Jun 15 16:00:53 2022] GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:54.057152 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-65e21831-7f7c-447e-853a-a126134b0ec5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8d85b3310>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:54.081691 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-65e21831-7f7c-447e-853a-a126134b0ec5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] HTTP exception thrown: Snapshot 490292ef-c2aa-45ec-b142-d23a5689f47d could not be found. Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-65e21831-7f7c-447e-853a-a126134b0ec5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Request method failure captured: Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d HTTP/1.1 Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgIuMy3WndEKnqrP2azKxNv_I-sBSAPMvmXCZNcuHv5szC7oxKPKI5TMwaAqDRadetlUuq9pFoNB7n_odGh4NcjrKcRjsPsXOfYT06jdPkk3ieVRbQi5OJs_Y8h2DJpRpi8Bh5xl2oOOCdEgTssfWPmFhLhPBG5nH5wOFn1ndYtp39c Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 333966f6f9da41e3b940ef9f253913c5 Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:00:54.084925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_333966f6f9da41e3b940ef9f253913c5", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 333966f6f9da41e3b940ef9f253913c5 Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-VolumesSnapshotsTestJSON-269421478-project Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 07b16e07166f48db9070ee57f57185e2 Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269421478-project Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Snapshot 490292ef-c2aa-45ec-b142-d23a5689f47d could not be found. Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '490292ef-c2aa-45ec-b142-d23a5689f47d'} Jun 15 16:00:54.086484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 490292ef-c2aa-45ec-b142-d23a5689f47d could not be found. (HTTP 404) (Request-ID: req-a69bee81-1a69-41da-b8ab-d5b4ee90410f) Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:54.087654 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 16:00:54.089029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 490292ef-c2aa-45ec-b142-d23a5689f47d could not be found. Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 15 16:00:54.090753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 490292ef-c2aa-45ec-b142-d23a5689f47d could not be found. Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 490292ef-c2aa-45ec-b142-d23a5689f47d could not be found. Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-65e21831-7f7c-447e-853a-a126134b0ec5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Returning 404 to user: Snapshot 490292ef-c2aa-45ec-b142-d23a5689f47d could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:00:54.092193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-65e21831-7f7c-447e-853a-a126134b0ec5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d" status: 404 len: 111 microversion: 2.1 time: 0.034208 Jun 15 16:00:54.093140 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 513/1005] 10.222.0.62 () {58 vars in 1250 bytes} [Wed Jun 15 16:00:54 2022] GET /compute/v2.1/os-snapshots/490292ef-c2aa-45ec-b142-d23a5689f47d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:00:54.094759 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b256af16-242a-4d6f-b785-f450630dbd0e tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8d81a83a0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:54.154081 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b256af16-242a-4d6f-b785-f450630dbd0e tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea" status: 202 len: 0 microversion: 2.1 time: 0.063020 Jun 15 16:00:54.154658 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 493/1006] 10.222.0.62 () {58 vars in 1247 bytes} [Wed Jun 15 16:00:54 2022] DELETE /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:00:54.163833 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-24374184-c48f-4282-997a-939673a0822d tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8dc121670>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:54.208980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-24374184-c48f-4282-997a-939673a0822d tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea" status: 200 len: 345 microversion: 2.1 time: 0.049776 Jun 15 16:00:54.210104 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 514/1007] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 16:00:54 2022] GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:00:55.222397 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5d96c373-a655-4721-a073-f1197aa16016 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8d8db50d0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:55.250072 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-5d96c373-a655-4721-a073-f1197aa16016 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] HTTP exception thrown: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5d96c373-a655-4721-a073-f1197aa16016 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Request method failure captured: Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea HTTP/1.1 Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgIuMy3WndEKnqrP2azKxNv_I-sBSAPMvmXCZNcuHv5szC7oxKPKI5TMwaAqDRadetlUuq9pFoNB7n_odGh4NcjrKcRjsPsXOfYT06jdPkk3ieVRbQi5OJs_Y8h2DJpRpi8Bh5xl2oOOCdEgTssfWPmFhLhPBG5nH5wOFn1ndYtp39c Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 333966f6f9da41e3b940ef9f253913c5 Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:00:55.252046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_333966f6f9da41e3b940ef9f253913c5", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 333966f6f9da41e3b940ef9f253913c5 Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-VolumesSnapshotsTestJSON-269421478-project Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 07b16e07166f48db9070ee57f57185e2 Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269421478-project Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': '48431a4b-23af-44e6-9c16-2fc0f6fb31ea'} Jun 15 16:00:55.253629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. (HTTP 404) (Request-ID: req-76537560-d4ab-4996-930c-9c8d31f793f7) Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:55.254825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 16:00:55.256504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 16:00:55.257725 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5d96c373-a655-4721-a073-f1197aa16016 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Returning 404 to user: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5d96c373-a655-4721-a073-f1197aa16016 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea" status: 404 len: 109 microversion: 2.1 time: 0.035413 Jun 15 16:00:55.259039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 494/1008] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 16:00:55 2022] GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:00:55.268105 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cc486948-b971-49b7-8e6f-17deb44c73d5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8dc0a4d30>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:55.295480 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-cc486948-b971-49b7-8e6f-17deb44c73d5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] HTTP exception thrown: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cc486948-b971-49b7-8e6f-17deb44c73d5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Request method failure captured: Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: DELETE /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea HTTP/1.1 Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgIuMy3WndEKnqrP2azKxNv_I-sBSAPMvmXCZNcuHv5szC7oxKPKI5TMwaAqDRadetlUuq9pFoNB7n_odGh4NcjrKcRjsPsXOfYT06jdPkk3ieVRbQi5OJs_Y8h2DJpRpi8Bh5xl2oOOCdEgTssfWPmFhLhPBG5nH5wOFn1ndYtp39c Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 333966f6f9da41e3b940ef9f253913c5 Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:00:55.297783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_333966f6f9da41e3b940ef9f253913c5", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 333966f6f9da41e3b940ef9f253913c5 Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-VolumesSnapshotsTestJSON-269421478-project Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 07b16e07166f48db9070ee57f57185e2 Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269421478-project Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '48431a4b-23af-44e6-9c16-2fc0f6fb31ea'} Jun 15 16:00:55.299398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. (HTTP 404) (Request-ID: req-df077d12-435e-4ee2-bd10-ebbe42cc34c8) Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:55.300462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 15 16:00:55.301900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 15 16:00:55.304176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cc486948-b971-49b7-8e6f-17deb44c73d5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Returning 404 to user: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-cc486948-b971-49b7-8e6f-17deb44c73d5 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea" status: 404 len: 109 microversion: 2.1 time: 0.035366 Jun 15 16:00:55.305555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 515/1009] 10.222.0.62 () {58 vars in 1247 bytes} [Wed Jun 15 16:00:55 2022] DELETE /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 16:00:55.308096 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e5d5b656-0bf5-48b0-8d55-fe87fdf53561 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Calling method '.version_select at 0x7fd8d3799dc0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:00:55.336153 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-e5d5b656-0bf5-48b0-8d55-fe87fdf53561 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] HTTP exception thrown: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e5d5b656-0bf5-48b0-8d55-fe87fdf53561 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Request method failure captured: Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea HTTP/1.1 Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgIuMy3WndEKnqrP2azKxNv_I-sBSAPMvmXCZNcuHv5szC7oxKPKI5TMwaAqDRadetlUuq9pFoNB7n_odGh4NcjrKcRjsPsXOfYT06jdPkk3ieVRbQi5OJs_Y8h2DJpRpi8Bh5xl2oOOCdEgTssfWPmFhLhPBG5nH5wOFn1ndYtp39c Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 333966f6f9da41e3b940ef9f253913c5 Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:00:55.338097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/333966f6f9da41e3b940ef9f253913c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_333966f6f9da41e3b940ef9f253913c5", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 333966f6f9da41e3b940ef9f253913c5 Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269421478 Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-VolumesSnapshotsTestJSON-269421478-project Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 07b16e07166f48db9070ee57f57185e2 Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269421478-project Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': '48431a4b-23af-44e6-9c16-2fc0f6fb31ea'} Jun 15 16:00:55.339662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. (HTTP 404) (Request-ID: req-15c40add-c8e8-4a9f-8beb-dde2e1897d05) Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:55.340545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 15 16:00:55.341682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 15 16:00:55.342802 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e5d5b656-0bf5-48b0-8d55-fe87fdf53561 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] Returning 404 to user: Volume 48431a4b-23af-44e6-9c16-2fc0f6fb31ea could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e5d5b656-0bf5-48b0-8d55-fe87fdf53561 tempest-VolumesSnapshotsTestJSON-269421478 tempest-VolumesSnapshotsTestJSON-269421478-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea" status: 404 len: 109 microversion: 2.1 time: 0.035250 Jun 15 16:00:55.344317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 495/1010] 10.222.0.62 () {58 vars in 1244 bytes} [Wed Jun 15 16:00:55 2022] GET /compute/v2.1/os-volumes/48431a4b-23af-44e6-9c16-2fc0f6fb31ea => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:01:22.351851 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-94083c4b-2c18-4180-9e1b-15e045894a0c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Action: 'create', calling method: .version_select at 0x7fd8dc175310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2141088859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQkN3D5DAR6bJZuHlXcPPm9kO2Uxy/OsyVZxzyOwfffeIm8br6HLKgeDpKD/F3nZsAfajIJt22rrs9wpfSoOSsVKbNczadB68LD4OZ36uTJgKFG4ERoVAKr7G71Sb+bHQ=="}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:01:22.365766 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-94083c4b-2c18-4180-9e1b-15e045894a0c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Getting quotas for project 31480d73f44447679761a5acac79dc02. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 16:01:22.370459 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-94083c4b-2c18-4180-9e1b-15e045894a0c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Getting quotas for user f18270589e8745a286e3c78a7f86b25d and project 31480d73f44447679761a5acac79dc02. Resources: {'key_pairs'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 16:01:22.418955 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-94083c4b-2c18-4180-9e1b-15e045894a0c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.258721 Jun 15 16:01:22.419597 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 516/1011] 10.222.0.62 () {60 vars in 1158 bytes} [Wed Jun 15 16:01:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:01:29.394974 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:01:29.537880 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2fba7e53-aa76-43a3-9d90-f7729d0cff22 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:29.538370 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2fba7e53-aa76-43a3-9d90-f7729d0cff22 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:29.544348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2fba7e53-aa76-43a3-9d90-f7729d0cff22 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:29.545279 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2fba7e53-aa76-43a3-9d90-f7729d0cff22 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:29.546026 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2fba7e53-aa76-43a3-9d90-f7729d0cff22 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:29.546452 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2fba7e53-aa76-43a3-9d90-f7729d0cff22 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:29.568934 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2fba7e53-aa76-43a3-9d90-f7729d0cff22 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/ips" status: 200 len: 150 microversion: 2.1 time: 0.175547 Jun 15 16:01:29.569452 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 496/1012] 10.222.0.62 () {58 vars in 1247 bytes} [Wed Jun 15 16:01:29 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/ips => generated 150 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:01:31.940238 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b75bf11d-047a-4ad4-9a69-1348659104f5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8584d42f-98d5-4abd-a8bb-e99ed0c06589"}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:01:31.941451 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b75bf11d-047a-4ad4-9a69-1348659104f5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:31.948933 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b75bf11d-047a-4ad4-9a69-1348659104f5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:31.949389 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b75bf11d-047a-4ad4-9a69-1348659104f5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:31.950322 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b75bf11d-047a-4ad4-9a69-1348659104f5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:31.951364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b75bf11d-047a-4ad4-9a69-1348659104f5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:32.216801 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b75bf11d-047a-4ad4-9a69-1348659104f5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "POST /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280979 Jun 15 16:01:32.217482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 517/1013] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 16:01:31 2022] POST /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:01:37.877280 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:01:37.877907 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 16:01:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:01:38.796554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:01:38.797150 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Wed Jun 15 16:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:01:39.894369 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1af01457-c95d-46e3-8e3a-abbdec7f3ca9 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:39.895578 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1af01457-c95d-46e3-8e3a-abbdec7f3ca9 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:39.902767 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:01:39.903939 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=4 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:01:39.905841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1af01457-c95d-46e3-8e3a-abbdec7f3ca9 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:39.906561 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1af01457-c95d-46e3-8e3a-abbdec7f3ca9 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:39.907515 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1af01457-c95d-46e3-8e3a-abbdec7f3ca9 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:39.908105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1af01457-c95d-46e3-8e3a-abbdec7f3ca9 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:40.009603 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-1af01457-c95d-46e3-8e3a-abbdec7f3ca9 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lazy-loading 'services' on Instance uuid acd8dffe-820f-45e3-925c-881780df5c8d {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:01:40.103545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1af01457-c95d-46e3-8e3a-abbdec7f3ca9 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/os-volume_attachments/8584d42f-98d5-4abd-a8bb-e99ed0c06589" status: 202 len: 0 microversion: 2.1 time: 0.213095 Jun 15 16:01:40.104693 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 497/1014] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 16:01:39 2022] DELETE /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/os-volume_attachments/8584d42f-98d5-4abd-a8bb-e99ed0c06589 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:01:40.113980 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-019a1da8-024b-4b37-9533-338bdfcb4f1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:40.116205 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-019a1da8-024b-4b37-9533-338bdfcb4f1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:40.120046 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=4 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:01:40.130364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-019a1da8-024b-4b37-9533-338bdfcb4f1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:40.131074 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-019a1da8-024b-4b37-9533-338bdfcb4f1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:40.132494 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-019a1da8-024b-4b37-9533-338bdfcb4f1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:40.133192 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-019a1da8-024b-4b37-9533-338bdfcb4f1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:40.193999 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-019a1da8-024b-4b37-9533-338bdfcb4f1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084807 Jun 15 16:01:40.200153 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 518/1015] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 16:01:40 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 16:01:41.208974 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ecae03bd-b23b-4dfe-aecc-59c75948bcef tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:41.211139 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ecae03bd-b23b-4dfe-aecc-59c75948bcef tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:41.227682 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ecae03bd-b23b-4dfe-aecc-59c75948bcef tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:41.228278 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ecae03bd-b23b-4dfe-aecc-59c75948bcef tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:41.229959 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ecae03bd-b23b-4dfe-aecc-59c75948bcef tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:41.230648 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ecae03bd-b23b-4dfe-aecc-59c75948bcef tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:41.268315 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ecae03bd-b23b-4dfe-aecc-59c75948bcef tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065752 Jun 15 16:01:41.268923 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 498/1016] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 16:01:41 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 16:01:41.335191 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-50accd78-f9b3-4880-b3b3-0fe0de729fa2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:41.335883 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-50accd78-f9b3-4880-b3b3-0fe0de729fa2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:41.343358 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-50accd78-f9b3-4880-b3b3-0fe0de729fa2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:41.343803 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-50accd78-f9b3-4880-b3b3-0fe0de729fa2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:41.344562 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-50accd78-f9b3-4880-b3b3-0fe0de729fa2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:41.344989 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-50accd78-f9b3-4880-b3b3-0fe0de729fa2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:41.388444 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-50accd78-f9b3-4880-b3b3-0fe0de729fa2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Going to try to terminate instance {{(pid=123934) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 16:01:41.526322 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-50accd78-f9b3-4880-b3b3-0fe0de729fa2 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 204 len: 0 microversion: 2.1 time: 0.194811 Jun 15 16:01:41.527636 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 519/1017] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:01:41 2022] DELETE /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 16:01:41.537191 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2168e357-cb70-4a2c-bfd7-d566b52dc986 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:41.538700 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2168e357-cb70-4a2c-bfd7-d566b52dc986 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:41.546308 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2168e357-cb70-4a2c-bfd7-d566b52dc986 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:41.547031 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2168e357-cb70-4a2c-bfd7-d566b52dc986 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:41.548000 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2168e357-cb70-4a2c-bfd7-d566b52dc986 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:41.548598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2168e357-cb70-4a2c-bfd7-d566b52dc986 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:41.724106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2168e357-cb70-4a2c-bfd7-d566b52dc986 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:41.734780 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2168e357-cb70-4a2c-bfd7-d566b52dc986 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1682 microversion: 2.1 time: 0.202596 Jun 15 16:01:41.736077 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 499/1018] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:41 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:01:42.752902 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-265ec664-f5dd-4439-b26b-950e386e7c1c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:42.754255 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-265ec664-f5dd-4439-b26b-950e386e7c1c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:42.761009 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-265ec664-f5dd-4439-b26b-950e386e7c1c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:42.761454 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-265ec664-f5dd-4439-b26b-950e386e7c1c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:42.762221 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-265ec664-f5dd-4439-b26b-950e386e7c1c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:42.762852 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-265ec664-f5dd-4439-b26b-950e386e7c1c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:42.901116 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-265ec664-f5dd-4439-b26b-950e386e7c1c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:42.912310 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-265ec664-f5dd-4439-b26b-950e386e7c1c tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1682 microversion: 2.1 time: 0.163131 Jun 15 16:01:42.913560 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 520/1019] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:42 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:01:43.931390 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-597741be-d8a5-4867-b7bd-f844df15090a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:43.932695 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-597741be-d8a5-4867-b7bd-f844df15090a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:43.940533 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-597741be-d8a5-4867-b7bd-f844df15090a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:43.941615 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-597741be-d8a5-4867-b7bd-f844df15090a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:43.942681 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-597741be-d8a5-4867-b7bd-f844df15090a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:43.943735 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-597741be-d8a5-4867-b7bd-f844df15090a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:44.138311 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-597741be-d8a5-4867-b7bd-f844df15090a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:44.146296 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-597741be-d8a5-4867-b7bd-f844df15090a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1682 microversion: 2.1 time: 0.219920 Jun 15 16:01:44.147248 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 500/1020] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:43 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:01:45.166835 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1b8af871-137d-4e0f-8580-7644c1af6161 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:45.167458 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1b8af871-137d-4e0f-8580-7644c1af6161 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:45.176027 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1b8af871-137d-4e0f-8580-7644c1af6161 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:45.176715 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1b8af871-137d-4e0f-8580-7644c1af6161 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:45.177994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1b8af871-137d-4e0f-8580-7644c1af6161 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:45.178977 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1b8af871-137d-4e0f-8580-7644c1af6161 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:45.340292 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1b8af871-137d-4e0f-8580-7644c1af6161 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:45.349161 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1b8af871-137d-4e0f-8580-7644c1af6161 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1682 microversion: 2.1 time: 0.189044 Jun 15 16:01:45.355081 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 521/1021] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:45 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:01:46.369966 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-21718a36-bfaa-416b-9742-d3abd6edefca tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:46.371582 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-21718a36-bfaa-416b-9742-d3abd6edefca tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:46.386354 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21718a36-bfaa-416b-9742-d3abd6edefca tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:46.398797 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21718a36-bfaa-416b-9742-d3abd6edefca tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:46.399656 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21718a36-bfaa-416b-9742-d3abd6edefca tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:46.400106 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21718a36-bfaa-416b-9742-d3abd6edefca tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:46.441696 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-e01c6570-de51-45b5-acd8-d0072607bcfc req-90500f32-3efe-4122-803e-364510bf038f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd8dffe-820f-45e3-925c-881780df5c8d", "name": "network-vif-deleted", "tag": "7f8a4730-b2cf-4a02-87a9-0dd60103021a"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:01:46.463889 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21718a36-bfaa-416b-9742-d3abd6edefca tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:46.464642 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21718a36-bfaa-416b-9742-d3abd6edefca tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:46.464871 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-e01c6570-de51-45b5-acd8-d0072607bcfc req-90500f32-3efe-4122-803e-364510bf038f service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:46.465433 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-21718a36-bfaa-416b-9742-d3abd6edefca tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lazy-loading 'fault' on Instance uuid acd8dffe-820f-45e3-925c-881780df5c8d {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:01:46.465699 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-e01c6570-de51-45b5-acd8-d0072607bcfc req-90500f32-3efe-4122-803e-364510bf038f service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:46.481346 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-e01c6570-de51-45b5-acd8-d0072607bcfc req-90500f32-3efe-4122-803e-364510bf038f service nova] Creating event network-vif-deleted:7f8a4730-b2cf-4a02-87a9-0dd60103021a for instance acd8dffe-820f-45e3-925c-881780df5c8d on hv-cinder-84599 Jun 15 16:01:46.489358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-e01c6570-de51-45b5-acd8-d0072607bcfc req-90500f32-3efe-4122-803e-364510bf038f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309410 Jun 15 16:01:46.490580 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 501/1022] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:01:46.515852 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-21718a36-bfaa-416b-9742-d3abd6edefca tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb838f931b7748e2baf6c2315d3cbd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0496c4ee9cdf486684000904876d0b6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:46.525781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-21718a36-bfaa-416b-9742-d3abd6edefca tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 200 len: 1331 microversion: 2.1 time: 0.160613 Jun 15 16:01:46.526420 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 522/1023] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:46 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:01:47.544780 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-70b95f6b-7e04-41b3-a5e3-47b2865bf246 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:47.546103 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-70b95f6b-7e04-41b3-a5e3-47b2865bf246 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:47.553149 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70b95f6b-7e04-41b3-a5e3-47b2865bf246 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:47.553865 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70b95f6b-7e04-41b3-a5e3-47b2865bf246 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:47.554844 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70b95f6b-7e04-41b3-a5e3-47b2865bf246 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:47.555469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70b95f6b-7e04-41b3-a5e3-47b2865bf246 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:47.579951 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-70b95f6b-7e04-41b3-a5e3-47b2865bf246 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-70b95f6b-7e04-41b3-a5e3-47b2865bf246 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d HTTP/1.1 Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:01:47.581917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:47.583348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'acd8dffe-820f-45e3-925c-881780df5c8d'} Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:47.584140 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:47.586302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:47.591609 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-70b95f6b-7e04-41b3-a5e3-47b2865bf246 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:47.593040 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-70b95f6b-7e04-41b3-a5e3-47b2865bf246 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 404 len: 111 microversion: 2.1 time: 0.052699 Jun 15 16:01:47.594097 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 502/1024] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:47 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:01:47.602916 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-815c43db-b0e2-4230-9a4e-a18e8d11af1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '.version_select at 0x7fd8dc1e4ca0>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:47.630760 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-815c43db-b0e2-4230-9a4e-a18e8d11af1a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705464102" status: 202 len: 0 microversion: 2.1 time: 0.031916 Jun 15 16:01:47.631252 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 523/1025] 10.222.0.62 () {58 vars in 1217 bytes} [Wed Jun 15 16:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705464102 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:01:49.934399 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e58079ca-2268-4388-9cad-e03a2e228743 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:49.935057 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e58079ca-2268-4388-9cad-e03a2e228743 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:49.943471 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e58079ca-2268-4388-9cad-e03a2e228743 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:49.943925 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e58079ca-2268-4388-9cad-e03a2e228743 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:49.945691 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e58079ca-2268-4388-9cad-e03a2e228743 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:49.948586 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e58079ca-2268-4388-9cad-e03a2e228743 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:49.971390 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-e58079ca-2268-4388-9cad-e03a2e228743 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e58079ca-2268-4388-9cad-e03a2e228743 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: DELETE /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d HTTP/1.1 Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:01:49.973481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:49.976226 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'acd8dffe-820f-45e3-925c-881780df5c8d'} Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:49.977095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:49.978484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:49.983377 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e58079ca-2268-4388-9cad-e03a2e228743 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:49.984492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e58079ca-2268-4388-9cad-e03a2e228743 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 404 len: 111 microversion: 2.1 time: 0.054880 Jun 15 16:01:50.001485 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-787ad082-71a7-488d-be7a-1f3025e5df67 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:50.002349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-787ad082-71a7-488d-be7a-1f3025e5df67 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: acd8dffe-820f-45e3-925c-881780df5c8d] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:50.007515 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 503/1026] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:01:49 2022] DELETE /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:01:50.031232 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-787ad082-71a7-488d-be7a-1f3025e5df67 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:50.031775 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-787ad082-71a7-488d-be7a-1f3025e5df67 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:50.037186 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-787ad082-71a7-488d-be7a-1f3025e5df67 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:50.037747 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-787ad082-71a7-488d-be7a-1f3025e5df67 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:50.071610 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-787ad082-71a7-488d-be7a-1f3025e5df67 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-787ad082-71a7-488d-be7a-1f3025e5df67 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d HTTP/1.1 Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:01:50.073683 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:50.075156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': 'acd8dffe-820f-45e3-925c-881780df5c8d'} Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:50.075930 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. Jun 15 16:01:50.077229 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:50.081217 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-787ad082-71a7-488d-be7a-1f3025e5df67 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance acd8dffe-820f-45e3-925c-881780df5c8d could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:50.082307 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-787ad082-71a7-488d-be7a-1f3025e5df67 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d" status: 404 len: 111 microversion: 2.1 time: 0.085756 Jun 15 16:01:50.083420 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 524/1027] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:49 2022] GET /compute/v2.1/servers/acd8dffe-820f-45e3-925c-881780df5c8d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 16:01:50.354507 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-15680826-30a7-43cf-9421-f01187f70b56 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:50.356590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-15680826-30a7-43cf-9421-f01187f70b56 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:50.362872 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-15680826-30a7-43cf-9421-f01187f70b56 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:50.363568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-15680826-30a7-43cf-9421-f01187f70b56 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:50.364491 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-15680826-30a7-43cf-9421-f01187f70b56 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:50.365073 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-15680826-30a7-43cf-9421-f01187f70b56 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:50.430282 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-15680826-30a7-43cf-9421-f01187f70b56 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.080332 Jun 15 16:01:50.430901 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 504/1028] 10.222.0.62 () {60 vars in 1342 bytes} [Wed Jun 15 16:01:50 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:01:50.572136 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-46c1c0f8-f45f-480a-ba69-90ee2bb47d96 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:50.578442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-46c1c0f8-f45f-480a-ba69-90ee2bb47d96 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:50.592658 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-46c1c0f8-f45f-480a-ba69-90ee2bb47d96 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:50.597202 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-46c1c0f8-f45f-480a-ba69-90ee2bb47d96 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:50.598480 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-46c1c0f8-f45f-480a-ba69-90ee2bb47d96 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:50.601325 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-46c1c0f8-f45f-480a-ba69-90ee2bb47d96 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:50.628598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-630621046", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2141088859", "security_groups": [{"name": "tempest-secgroup-smoke-662739945"}], "block_device_mapping_v2": [{"uuid": "29e1d6da-0d85-4c8c-ad32-6eac6aeb96e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b3187a5-ab83-4eae-958d-943b33483207"}]}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:01:50.652671 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-46c1c0f8-f45f-480a-ba69-90ee2bb47d96 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Going to try to terminate instance {{(pid=123934) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 16:01:50.789374 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-46c1c0f8-f45f-480a-ba69-90ee2bb47d96 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 204 len: 0 microversion: 2.20 time: 0.231921 Jun 15 16:01:50.790606 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 525/1029] 10.222.0.62 () {60 vars in 1279 bytes} [Wed Jun 15 16:01:50 2022] DELETE /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 15 16:01:50.799894 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7d29bacc-4f5e-42ac-b4d9-9c7ba38e294a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:50.800992 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7d29bacc-4f5e-42ac-b4d9-9c7ba38e294a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:50.808689 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7d29bacc-4f5e-42ac-b4d9-9c7ba38e294a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:50.809581 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7d29bacc-4f5e-42ac-b4d9-9c7ba38e294a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:50.811426 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7d29bacc-4f5e-42ac-b4d9-9c7ba38e294a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:50.812235 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7d29bacc-4f5e-42ac-b4d9-9c7ba38e294a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:50.833287 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] validate_networks() for [('9b3187a5-ab83-4eae-958d-943b33483207', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 16:01:51.058759 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7d29bacc-4f5e-42ac-b4d9-9c7ba38e294a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:51.067873 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7d29bacc-4f5e-42ac-b4d9-9c7ba38e294a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:51.070267 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7d29bacc-4f5e-42ac-b4d9-9c7ba38e294a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:51.071818 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7d29bacc-4f5e-42ac-b4d9-9c7ba38e294a tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.276922 Jun 15 16:01:51.072544 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 526/1030] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:01:50 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:01:51.320499 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-102eb73a-d405-4603-96d6-a34b9737eaa5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:51.321327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-102eb73a-d405-4603-96d6-a34b9737eaa5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:51.334022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-102eb73a-d405-4603-96d6-a34b9737eaa5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:51.334990 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-102eb73a-d405-4603-96d6-a34b9737eaa5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:51.335457 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-102eb73a-d405-4603-96d6-a34b9737eaa5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:51.335914 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-102eb73a-d405-4603-96d6-a34b9737eaa5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:51.363693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-102eb73a-d405-4603-96d6-a34b9737eaa5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-102eb73a-d405-4603-96d6-a34b9737eaa5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: DELETE /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 HTTP/1.1 Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:01:51.372061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 16:01:51.373563 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '5bfc8df9-5cac-41ce-8af4-47483c7b5d95'} Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:51.374327 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 16:01:51.375640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.376884 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-102eb73a-d405-4603-96d6-a34b9737eaa5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:51.376884 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-102eb73a-d405-4603-96d6-a34b9737eaa5 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 404 len: 111 microversion: 2.1 time: 0.059582 Jun 15 16:01:51.376884 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 527/1031] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:01:51 2022] DELETE /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 16:01:51.389269 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-611d90a2-cadf-44f7-9c08-b347f3bb508a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:51.390586 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-611d90a2-cadf-44f7-9c08-b347f3bb508a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 5bfc8df9-5cac-41ce-8af4-47483c7b5d95] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:51.399086 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-611d90a2-cadf-44f7-9c08-b347f3bb508a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:51.399631 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-611d90a2-cadf-44f7-9c08-b347f3bb508a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:51.400931 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-611d90a2-cadf-44f7-9c08-b347f3bb508a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:51.401835 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-611d90a2-cadf-44f7-9c08-b347f3bb508a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:51.420442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-611d90a2-cadf-44f7-9c08-b347f3bb508a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-611d90a2-cadf-44f7-9c08-b347f3bb508a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 HTTP/1.1 Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:01:51.422411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 16:01:51.423843 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '5bfc8df9-5cac-41ce-8af4-47483c7b5d95'} Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:51.424616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. Jun 15 16:01:51.425831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.427059 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-611d90a2-cadf-44f7-9c08-b347f3bb508a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance 5bfc8df9-5cac-41ce-8af4-47483c7b5d95 could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:51.427059 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-611d90a2-cadf-44f7-9c08-b347f3bb508a tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95" status: 404 len: 111 microversion: 2.1 time: 0.039932 Jun 15 16:01:51.427059 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 528/1032] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:51 2022] GET /compute/v2.1/servers/5bfc8df9-5cac-41ce-8af4-47483c7b5d95 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:01:51.434691 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-48041254-994f-4258-aa14-62041344575f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:51.435479 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-48041254-994f-4258-aa14-62041344575f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:51.441950 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48041254-994f-4258-aa14-62041344575f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:51.442676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48041254-994f-4258-aa14-62041344575f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:51.443794 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48041254-994f-4258-aa14-62041344575f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:51.443910 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-48041254-994f-4258-aa14-62041344575f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:51.460405 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-48041254-994f-4258-aa14-62041344575f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-48041254-994f-4258-aa14-62041344575f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: DELETE /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b HTTP/1.1 Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:01:51.461969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 16:01:51.463629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '4e3418e7-7db0-4525-93e2-9646dde34b8b'} Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:51.464539 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 16:01:51.466110 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.468023 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-48041254-994f-4258-aa14-62041344575f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:51.469258 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-48041254-994f-4258-aa14-62041344575f tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 404 len: 111 microversion: 2.1 time: 0.039173 Jun 15 16:01:51.472756 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 529/1033] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:01:51 2022] DELETE /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 15 16:01:51.481165 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-de2d2c03-dc81-4176-8bca-7b283d476002 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:51.481782 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-de2d2c03-dc81-4176-8bca-7b283d476002 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: 4e3418e7-7db0-4525-93e2-9646dde34b8b] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:51.497122 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-de2d2c03-dc81-4176-8bca-7b283d476002 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:51.497572 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-de2d2c03-dc81-4176-8bca-7b283d476002 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:51.498362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-de2d2c03-dc81-4176-8bca-7b283d476002 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:51.498821 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-de2d2c03-dc81-4176-8bca-7b283d476002 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:51.518511 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-de2d2c03-dc81-4176-8bca-7b283d476002 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-de2d2c03-dc81-4176-8bca-7b283d476002 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b HTTP/1.1 Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:01:51.521185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 16:01:51.522596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '4e3418e7-7db0-4525-93e2-9646dde34b8b'} Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:51.523437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. Jun 15 16:01:51.528501 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:51.530041 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-de2d2c03-dc81-4176-8bca-7b283d476002 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance 4e3418e7-7db0-4525-93e2-9646dde34b8b could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:51.530041 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-de2d2c03-dc81-4176-8bca-7b283d476002 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b" status: 404 len: 111 microversion: 2.1 time: 0.046592 Jun 15 16:01:51.530041 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 530/1034] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:51 2022] GET /compute/v2.1/servers/4e3418e7-7db0-4525-93e2-9646dde34b8b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:01:51.542521 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 16:01:51.543057 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 16:01:51.543430 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 16:01:51.543837 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 16:01:51.544389 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 16:01:51.554501 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:51.554914 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:51.555710 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:51.560851 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:51.581013 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Getting quotas for project 31480d73f44447679761a5acac79dc02. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 16:01:51.585335 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Getting quotas for user f18270589e8745a286e3c78a7f86b25d and project 31480d73f44447679761a5acac79dc02. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 16:01:51.701355 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 16:01:51.703528 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29e1d6da-0d85-4c8c-ad32-6eac6aeb96e2',volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 16:01:51.863312 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-aadf8ab2-728b-4d66-8941-544f3e410728 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.242522 Jun 15 16:01:51.869559 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 505/1035] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 16:01:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 16:01:51.874959 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e587f39f-5de2-4fe2-b52e-9cdcf5b2503a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:51.875796 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e587f39f-5de2-4fe2-b52e-9cdcf5b2503a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:51.941879 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-e587f39f-5de2-4fe2-b52e-9cdcf5b2503a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:51.955138 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e587f39f-5de2-4fe2-b52e-9cdcf5b2503a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1094 microversion: 2.1 time: 0.083601 Jun 15 16:01:51.955731 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 531/1036] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:51 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:01:52.091463 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3de97557-5a49-4f1c-9e25-6d2645577faf tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:52.092267 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3de97557-5a49-4f1c-9e25-6d2645577faf tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:52.103253 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3de97557-5a49-4f1c-9e25-6d2645577faf tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:52.107967 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3de97557-5a49-4f1c-9e25-6d2645577faf tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:52.109538 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3de97557-5a49-4f1c-9e25-6d2645577faf tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:52.110206 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3de97557-5a49-4f1c-9e25-6d2645577faf tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:52.291729 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3de97557-5a49-4f1c-9e25-6d2645577faf tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:52.306761 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3de97557-5a49-4f1c-9e25-6d2645577faf tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:52.308295 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3de97557-5a49-4f1c-9e25-6d2645577faf tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:52.309476 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3de97557-5a49-4f1c-9e25-6d2645577faf tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.223371 Jun 15 16:01:52.310199 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 506/1037] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:01:52 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:01:52.736371 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dec9efb7-a86b-48ff-bb0e-e0834e000882 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:52.737604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-dec9efb7-a86b-48ff-bb0e-e0834e000882 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:52.745466 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:01:52.747982 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dec9efb7-a86b-48ff-bb0e-e0834e000882 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:52.748369 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dec9efb7-a86b-48ff-bb0e-e0834e000882 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:52.749437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dec9efb7-a86b-48ff-bb0e-e0834e000882 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:52.750036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dec9efb7-a86b-48ff-bb0e-e0834e000882 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:52.753232 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:01:52.768277 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-dec9efb7-a86b-48ff-bb0e-e0834e000882 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dec9efb7-a86b-48ff-bb0e-e0834e000882 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: DELETE /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa HTTP/1.1 Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:01:52.770546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 16:01:52.772157 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': 'caa56f23-7713-4cc8-936c-b4f47a8506aa'} Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:52.773088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 16:01:52.774522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:01:52.776616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dec9efb7-a86b-48ff-bb0e-e0834e000882 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:52.777449 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-dec9efb7-a86b-48ff-bb0e-e0834e000882 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "DELETE /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 404 len: 111 microversion: 2.1 time: 0.047328 Jun 15 16:01:52.778310 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 532/1038] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:01:52 2022] DELETE /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:01:52.787827 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-794f6a6d-0147-484d-86b7-4e6cf99dc8b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:52.796064 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-794f6a6d-0147-484d-86b7-4e6cf99dc8b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] [instance: caa56f23-7713-4cc8-936c-b4f47a8506aa] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:52.806972 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-794f6a6d-0147-484d-86b7-4e6cf99dc8b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:52.808192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-794f6a6d-0147-484d-86b7-4e6cf99dc8b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:52.809589 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-794f6a6d-0147-484d-86b7-4e6cf99dc8b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:52.810238 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-794f6a6d-0147-484d-86b7-4e6cf99dc8b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:52.827677 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-794f6a6d-0147-484d-86b7-4e6cf99dc8b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] HTTP exception thrown: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-794f6a6d-0147-484d-86b7-4e6cf99dc8b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Request method failure captured: Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa HTTP/1.1 Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-sDAkNKjDpC2UiRQ2uF00cNnHWT17WjP4tWNSfluNfukQ8H_2QCeG1ppVFte_nyOxm5fSfs9tLxissTYZl3Eqd2hFcTBCehIQS-aVArgpNnP7eErGEHoKLqQriFunt3tHFsnC64xNPO0GP3qg9y2sgDf5hwDxgtcspisjZ8IQj-N4 Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:01:52.829719 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/0496c4ee9cdf486684000904876d0b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_0496c4ee9cdf486684000904876d0b6b", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 0496c4ee9cdf486684000904876d0b6b Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-91535878 Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: fb838f931b7748e2baf6c2315d3cbd75 Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-AttachVolumeNegativeTest-91535878-project Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 16:01:52.831469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'caa56f23-7713-4cc8-936c-b4f47a8506aa'} Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:52.832373 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. Jun 15 16:01:52.833852 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:52.835227 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-794f6a6d-0147-484d-86b7-4e6cf99dc8b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] Returning 404 to user: Instance caa56f23-7713-4cc8-936c-b4f47a8506aa could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:52.836043 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-794f6a6d-0147-484d-86b7-4e6cf99dc8b6 tempest-AttachVolumeNegativeTest-91535878 tempest-AttachVolumeNegativeTest-91535878-project] 10.222.0.62 "GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa" status: 404 len: 111 microversion: 2.1 time: 0.052493 Jun 15 16:01:52.837060 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 507/1039] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:52 2022] GET /compute/v2.1/servers/caa56f23-7713-4cc8-936c-b4f47a8506aa => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:01:52.974909 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-565805f2-5b92-4b41-9932-277dc28a3cb9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:52.976386 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-565805f2-5b92-4b41-9932-277dc28a3cb9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:52.987718 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-565805f2-5b92-4b41-9932-277dc28a3cb9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:52.988452 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-565805f2-5b92-4b41-9932-277dc28a3cb9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:52.989393 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-565805f2-5b92-4b41-9932-277dc28a3cb9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:52.990074 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-565805f2-5b92-4b41-9932-277dc28a3cb9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:53.090346 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-565805f2-5b92-4b41-9932-277dc28a3cb9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:53.109054 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-565805f2-5b92-4b41-9932-277dc28a3cb9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1192 microversion: 2.1 time: 0.139733 Jun 15 16:01:53.109630 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 533/1040] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:52 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1192 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:01:53.329903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4029cb74-d48d-47e6-b84b-44513955167f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:53.331086 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4029cb74-d48d-47e6-b84b-44513955167f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:53.345055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4029cb74-d48d-47e6-b84b-44513955167f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:53.347183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4029cb74-d48d-47e6-b84b-44513955167f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:53.348401 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4029cb74-d48d-47e6-b84b-44513955167f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:53.350142 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4029cb74-d48d-47e6-b84b-44513955167f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:53.805650 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4029cb74-d48d-47e6-b84b-44513955167f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:53.816836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4029cb74-d48d-47e6-b84b-44513955167f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:53.820833 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4029cb74-d48d-47e6-b84b-44513955167f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:53.825230 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4029cb74-d48d-47e6-b84b-44513955167f tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1724 microversion: 2.20 time: 0.499339 Jun 15 16:01:53.839056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 508/1041] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:01:53 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1724 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:01:54.143853 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-45c2ed7d-7c7a-43a0-8d1e-eeee2739cf92 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:54.145224 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-45c2ed7d-7c7a-43a0-8d1e-eeee2739cf92 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:54.185774 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-7eea0746-b893-4f83-a181-a306ff47b9d6 req-6a1cf1e6-44e2-4036-807f-491c0961c5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c4bb33d-2d9f-4620-9e94-f28e12cd604f", "name": "network-vif-deleted", "tag": "6153ea23-abc5-46cb-96ff-6597e6888d85"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:01:54.208353 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-45c2ed7d-7c7a-43a0-8d1e-eeee2739cf92 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:54.213184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-45c2ed7d-7c7a-43a0-8d1e-eeee2739cf92 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:54.219852 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-45c2ed7d-7c7a-43a0-8d1e-eeee2739cf92 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:54.220551 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-45c2ed7d-7c7a-43a0-8d1e-eeee2739cf92 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:54.246280 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-7eea0746-b893-4f83-a181-a306ff47b9d6 req-6a1cf1e6-44e2-4036-807f-491c0961c5f2 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:54.246750 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-7eea0746-b893-4f83-a181-a306ff47b9d6 req-6a1cf1e6-44e2-4036-807f-491c0961c5f2 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:54.286649 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-7eea0746-b893-4f83-a181-a306ff47b9d6 req-6a1cf1e6-44e2-4036-807f-491c0961c5f2 service nova] Creating event network-vif-deleted:6153ea23-abc5-46cb-96ff-6597e6888d85 for instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f on hv-cinder-84599 Jun 15 16:01:54.297705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-7eea0746-b893-4f83-a181-a306ff47b9d6 req-6a1cf1e6-44e2-4036-807f-491c0961c5f2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121803 Jun 15 16:01:54.305396 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 509/1042] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:01:54.395778 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-45c2ed7d-7c7a-43a0-8d1e-eeee2739cf92 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:54.407218 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-45c2ed7d-7c7a-43a0-8d1e-eeee2739cf92 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1210 microversion: 2.1 time: 0.277968 Jun 15 16:01:54.418828 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 534/1043] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:54 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1210 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:01:54.847755 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:54.848459 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:54.862624 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:54.863392 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:54.864337 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:54.864936 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:54.927694 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:54.928422 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:54.929261 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lazy-loading 'fault' on Instance uuid 1c4bb33d-2d9f-4620-9e94-f28e12cd604f {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:01:55.029419 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:55.040388 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:55.048195 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af6df3efbb74db4958654503e17d82e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e7b007aaf80436f8fa691a12a95f21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:55.049492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-156adea9-61bd-4375-b53f-c4cc5fc1e5a1 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 200 len: 1372 microversion: 2.20 time: 0.206677 Jun 15 16:01:55.050139 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 510/1044] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:01:54 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 15 16:01:55.442809 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-24fe5e36-53a8-44bc-941b-441d7f8d51cb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:55.452885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-24fe5e36-53a8-44bc-941b-441d7f8d51cb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:55.476589 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-24fe5e36-53a8-44bc-941b-441d7f8d51cb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:55.477050 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-24fe5e36-53a8-44bc-941b-441d7f8d51cb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:55.479885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-24fe5e36-53a8-44bc-941b-441d7f8d51cb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:55.480546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-24fe5e36-53a8-44bc-941b-441d7f8d51cb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:56.067816 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-70b330cb-6bb4-4d20-882d-5bdde3f18fc8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:56.069769 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-70b330cb-6bb4-4d20-882d-5bdde3f18fc8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:56.079618 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70b330cb-6bb4-4d20-882d-5bdde3f18fc8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:56.080532 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70b330cb-6bb4-4d20-882d-5bdde3f18fc8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:56.081634 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70b330cb-6bb4-4d20-882d-5bdde3f18fc8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:56.082288 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70b330cb-6bb4-4d20-882d-5bdde3f18fc8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:56.101694 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-70b330cb-6bb4-4d20-882d-5bdde3f18fc8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] HTTP exception thrown: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-70b330cb-6bb4-4d20-882d-5bdde3f18fc8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Request method failure captured: Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f HTTP/1.1 Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-r6N4foMJuutu2sNAc27dMG4j4sMfGSN5HXKLCQIRoYj5qzh184gfmaLJyYfMs2LRcMVLz9UlfaNi_MO3BWE643SM4qdChJh0CloXr9P6kUr5Owx3SWe6HA4HKN_tdtWZVtmt3V8pInD4SxOWURcg8J1K0vHP5oxMTMmw5qRr-0_A Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:01:56.103714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e7b007aaf80436f8fa691a12a95f21e", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 3af6df3efbb74db4958654503e17d82e Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:56.105204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': '1c4bb33d-2d9f-4620-9e94-f28e12cd604f'} Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:56.106008 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:56.107269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:56.110210 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-70b330cb-6bb4-4d20-882d-5bdde3f18fc8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Returning 404 to user: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:56.111681 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-70b330cb-6bb4-4d20-882d-5bdde3f18fc8 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 404 len: 111 microversion: 2.20 time: 0.047800 Jun 15 16:01:56.112542 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 511/1045] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:01:56 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 15 16:01:56.123618 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ad11c999-3582-42ea-b32e-75137774fc31 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '.version_select at 0x7fd8d81a89d0>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:56.137145 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-24fe5e36-53a8-44bc-941b-441d7f8d51cb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:56.157068 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-24fe5e36-53a8-44bc-941b-441d7f8d51cb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.734170 Jun 15 16:01:56.158400 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ad11c999-3582-42ea-b32e-75137774fc31 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463660353" status: 204 len: 0 microversion: 2.20 time: 0.041386 Jun 15 16:01:56.167060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 535/1046] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:55 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:01:56.168127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 512/1047] 10.222.0.62 () {60 vars in 1261 bytes} [Wed Jun 15 16:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463660353 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 15 16:01:57.183789 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4733cd15-0c9e-4831-9c26-a9779d4bccfc tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:57.184421 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4733cd15-0c9e-4831-9c26-a9779d4bccfc tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:57.201548 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4733cd15-0c9e-4831-9c26-a9779d4bccfc tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:57.202300 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4733cd15-0c9e-4831-9c26-a9779d4bccfc tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:57.203457 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4733cd15-0c9e-4831-9c26-a9779d4bccfc tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:57.204062 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4733cd15-0c9e-4831-9c26-a9779d4bccfc tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:57.219414 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-e11d3a4c-5f3e-4020-be82-98738d6ea170 req-20d33fe0-2830-43df-ba31-9940bbedea77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e337762-1c2f-446b-b266-8a491f6f3a94", "tag": "d34c8693-5e99-46b1-adfb-f3f6cf283ae7"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:01:57.239258 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-e11d3a4c-5f3e-4020-be82-98738d6ea170 req-20d33fe0-2830-43df-ba31-9940bbedea77 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:57.240339 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-e11d3a4c-5f3e-4020-be82-98738d6ea170 req-20d33fe0-2830-43df-ba31-9940bbedea77 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:57.274627 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-e11d3a4c-5f3e-4020-be82-98738d6ea170 req-20d33fe0-2830-43df-ba31-9940bbedea77 service nova] Creating event network-changed:d34c8693-5e99-46b1-adfb-f3f6cf283ae7 for instance 6e337762-1c2f-446b-b266-8a491f6f3a94 on hv-cinder-84599 Jun 15 16:01:57.281911 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-e11d3a4c-5f3e-4020-be82-98738d6ea170 req-20d33fe0-2830-43df-ba31-9940bbedea77 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226341 Jun 15 16:01:57.284224 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 536/1048] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:01:57.636552 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-4733cd15-0c9e-4831-9c26-a9779d4bccfc tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:57.649031 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4733cd15-0c9e-4831-9c26-a9779d4bccfc tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.469228 Jun 15 16:01:57.650303 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 513/1049] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:57 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:01:58.666307 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cca4986a-12fe-4600-b43f-eb8b5e87aba0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:58.667721 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-cca4986a-12fe-4600-b43f-eb8b5e87aba0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:58.692565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cca4986a-12fe-4600-b43f-eb8b5e87aba0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:58.693673 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cca4986a-12fe-4600-b43f-eb8b5e87aba0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:58.695373 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cca4986a-12fe-4600-b43f-eb8b5e87aba0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:58.696052 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cca4986a-12fe-4600-b43f-eb8b5e87aba0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:59.034691 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-eb212473-0a20-45c5-9d08-aa82a70a5aab tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:59.035279 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-eb212473-0a20-45c5-9d08-aa82a70a5aab tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:59.049276 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eb212473-0a20-45c5-9d08-aa82a70a5aab tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:59.062261 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eb212473-0a20-45c5-9d08-aa82a70a5aab tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:59.063235 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eb212473-0a20-45c5-9d08-aa82a70a5aab tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:59.063616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eb212473-0a20-45c5-9d08-aa82a70a5aab tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:59.096313 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-eb212473-0a20-45c5-9d08-aa82a70a5aab tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] HTTP exception thrown: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-eb212473-0a20-45c5-9d08-aa82a70a5aab tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Request method failure captured: Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: DELETE /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f HTTP/1.1 Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-r6N4foMJuutu2sNAc27dMG4j4sMfGSN5HXKLCQIRoYj5qzh184gfmaLJyYfMs2LRcMVLz9UlfaNi_MO3BWE643SM4qdChJh0CloXr9P6kUr5Owx3SWe6HA4HKN_tdtWZVtmt3V8pInD4SxOWURcg8J1K0vHP5oxMTMmw5qRr-0_A Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:01:59.097903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e7b007aaf80436f8fa691a12a95f21e", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 3af6df3efbb74db4958654503e17d82e Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:59.099444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': '1c4bb33d-2d9f-4620-9e94-f28e12cd604f'} Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:59.100196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:59.102036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:59.105065 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-eb212473-0a20-45c5-9d08-aa82a70a5aab tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Returning 404 to user: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:59.105065 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-eb212473-0a20-45c5-9d08-aa82a70a5aab tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 404 len: 111 microversion: 2.20 time: 0.069502 Jun 15 16:01:59.105065 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 514/1050] 10.222.0.62 () {60 vars in 1279 bytes} [Wed Jun 15 16:01:59 2022] DELETE /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 16:01:59.109475 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a5cb5594-e06f-4d8c-aef1-c1b5a6030dea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:01:59.110102 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a5cb5594-e06f-4d8c-aef1-c1b5a6030dea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: 1c4bb33d-2d9f-4620-9e94-f28e12cd604f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:01:59.116403 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a5cb5594-e06f-4d8c-aef1-c1b5a6030dea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:59.116856 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a5cb5594-e06f-4d8c-aef1-c1b5a6030dea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:59.127160 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a5cb5594-e06f-4d8c-aef1-c1b5a6030dea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:01:59.127532 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a5cb5594-e06f-4d8c-aef1-c1b5a6030dea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:01:59.146580 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-a5cb5594-e06f-4d8c-aef1-c1b5a6030dea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] HTTP exception thrown: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a5cb5594-e06f-4d8c-aef1-c1b5a6030dea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Request method failure captured: Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f HTTP/1.1 Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqf-r6N4foMJuutu2sNAc27dMG4j4sMfGSN5HXKLCQIRoYj5qzh184gfmaLJyYfMs2LRcMVLz9UlfaNi_MO3BWE643SM4qdChJh0CloXr9P6kUr5Owx3SWe6HA4HKN_tdtWZVtmt3V8pInD4SxOWURcg8J1K0vHP5oxMTMmw5qRr-0_A Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:01:59.150499 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e7b007aaf80436f8fa691a12a95f21e", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 3af6df3efbb74db4958654503e17d82e Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:59.152039 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': '1c4bb33d-2d9f-4620-9e94-f28e12cd604f'} Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:01:59.152784 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. Jun 15 16:01:59.154778 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:01:59.158436 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a5cb5594-e06f-4d8c-aef1-c1b5a6030dea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Returning 404 to user: Instance 1c4bb33d-2d9f-4620-9e94-f28e12cd604f could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:01:59.159881 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a5cb5594-e06f-4d8c-aef1-c1b5a6030dea tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f" status: 404 len: 111 microversion: 2.20 time: 0.055170 Jun 15 16:01:59.160532 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 515/1051] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:01:59 2022] GET /compute/v2.1/servers/1c4bb33d-2d9f-4620-9e94-f28e12cd604f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 16:01:59.197646 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cca4986a-12fe-4600-b43f-eb8b5e87aba0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:01:59.201462 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fa83d907-bee8-4425-98bf-b57cc98b22a4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Action: 'create', calling method: .version_select at 0x7fd8d81b83a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-691801678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5UkNN4zCLTmQXx+WgDu4ZqOSHMlCymJV/PG+Mf0SpfHl+9cqp1mIx+dYHoc6OlKvNXogTgGXMVsHTzeNsnqKRAOAKFprUHNgwF8BodVamhgn5R8sKsOlZHsKA0wkO/Iw=="}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:01:59.205987 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-cca4986a-12fe-4600-b43f-eb8b5e87aba0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.544239 Jun 15 16:01:59.206561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 537/1052] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:01:58 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:01:59.218751 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-fa83d907-bee8-4425-98bf-b57cc98b22a4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Getting quotas for project 4cd1cf864eca4b0eb909e812b7de3f3f. Resources: {'key_pairs'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 16:01:59.223568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-fa83d907-bee8-4425-98bf-b57cc98b22a4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Getting quotas for user 12a0715ba0494afd8194655dee4b80ab and project 4cd1cf864eca4b0eb909e812b7de3f3f. Resources: {'key_pairs'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 16:01:59.247637 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fa83d907-bee8-4425-98bf-b57cc98b22a4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050749 Jun 15 16:01:59.248695 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 516/1053] 10.222.0.62 () {60 vars in 1158 bytes} [Wed Jun 15 16:01:59 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 16:01:59.317290 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1800032241", "imageRef": "845d5f88-d53e-4a50-a62b-1aca037f3d99", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-691801678", "networks": [{"uuid": "c02df6a2-15f3-4cc6-8340-4228cdbb4bfd"}]}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:01:59.385243 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.network.neutron [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] validate_networks() for [('c02df6a2-15f3-4cc6-8340-4228cdbb4bfd', None, None, None, None, None)] {{(pid=123934) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 16:02:00.154911 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Flavor limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 16:02:00.155510 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Image limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 16:02:00.155783 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Flavor pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 16:02:00.156184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Image pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 16:02:00.156584 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 16:02:00.169800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:00.170617 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:00.171685 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:00.172436 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:00.201775 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Getting quotas for project 4cd1cf864eca4b0eb909e812b7de3f3f. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 16:02:00.208015 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Getting quotas for user 12a0715ba0494afd8194655dee4b80ab and project 4cd1cf864eca4b0eb909e812b7de3f3f. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 16:02:00.223028 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Going to run 1 instances... {{(pid=123934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 16:02:00.225342 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='845d5f88-d53e-4a50-a62b-1aca037f3d99',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 16:02:00.227243 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9c2b87e6-eb1f-499f-96c0-895a0d4e271a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:00.228044 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9c2b87e6-eb1f-499f-96c0-895a0d4e271a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:00.243276 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9c2b87e6-eb1f-499f-96c0-895a0d4e271a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:00.243742 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9c2b87e6-eb1f-499f-96c0-895a0d4e271a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:00.247134 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9c2b87e6-eb1f-499f-96c0-895a0d4e271a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:00.248448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9c2b87e6-eb1f-499f-96c0-895a0d4e271a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:00.297626 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4afef2de-18aa-4e62-8d76-ac65c2a3c132 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984997 Jun 15 16:02:00.302893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 538/1054] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 16:01:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 16:02:00.309024 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a7ea6559-d331-4e45-89f7-1219bf06d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:00.309567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a7ea6559-d331-4e45-89f7-1219bf06d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:00.380961 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a7ea6559-d331-4e45-89f7-1219bf06d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:00.393347 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a7ea6559-d331-4e45-89f7-1219bf06d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1258 microversion: 2.1 time: 0.089057 Jun 15 16:02:00.394332 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 539/1055] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:00 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:00.412957 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-aa6dc0a9-a5ac-4ebb-85f8-1be5719d0450 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:00.414001 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-aa6dc0a9-a5ac-4ebb-85f8-1be5719d0450 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:00.423668 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa6dc0a9-a5ac-4ebb-85f8-1be5719d0450 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:00.424114 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa6dc0a9-a5ac-4ebb-85f8-1be5719d0450 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:00.426004 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa6dc0a9-a5ac-4ebb-85f8-1be5719d0450 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:00.426474 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-aa6dc0a9-a5ac-4ebb-85f8-1be5719d0450 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:00.443399 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-aa6dc0a9-a5ac-4ebb-85f8-1be5719d0450 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] HTTP exception thrown: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-aa6dc0a9-a5ac-4ebb-85f8-1be5719d0450 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Request method failure captured: Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: DELETE /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed HTTP/1.1 Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-r6N4foMJuutu2sNAc27dMG4j4sMfGSN5HXKLCQIRoYj5qzh184gfmaLJyYfMs2LRcMVLz9UlfaNi_MO3BWE643SM4qdChJh0CloXr9P6kUr5Owx3SWe6HA4HKN_tdtWZVtmt3V8pInD4SxOWURcg8J1K0vHP5oxMTMmw5qRr-0_A Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:02:00.445349 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e7b007aaf80436f8fa691a12a95f21e", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 3af6df3efbb74db4958654503e17d82e Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 16:02:00.446753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': 'c8ff33fe-05bf-4bd5-9159-69805bae0aed'} Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:02:00.447527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 16:02:00.448850 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:02:00.450090 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-aa6dc0a9-a5ac-4ebb-85f8-1be5719d0450 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Returning 404 to user: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:02:00.450090 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-aa6dc0a9-a5ac-4ebb-85f8-1be5719d0450 tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 404 len: 111 microversion: 2.20 time: 0.051929 Jun 15 16:02:00.451857 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 540/1056] 10.222.0.62 () {60 vars in 1279 bytes} [Wed Jun 15 16:02:00 2022] DELETE /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 16:02:00.457153 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bf712032-d7e3-4cca-8150-391821d4261b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:00.457769 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bf712032-d7e3-4cca-8150-391821d4261b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] [instance: c8ff33fe-05bf-4bd5-9159-69805bae0aed] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:00.465493 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf712032-d7e3-4cca-8150-391821d4261b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:00.466338 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf712032-d7e3-4cca-8150-391821d4261b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:00.467309 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf712032-d7e3-4cca-8150-391821d4261b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:00.467799 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bf712032-d7e3-4cca-8150-391821d4261b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:00.470449 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9c2b87e6-eb1f-499f-96c0-895a0d4e271a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:00.479213 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9c2b87e6-eb1f-499f-96c0-895a0d4e271a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.258500 Jun 15 16:02:00.479890 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 517/1057] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:00 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:00.483325 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-bf712032-d7e3-4cca-8150-391821d4261b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] HTTP exception thrown: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bf712032-d7e3-4cca-8150-391821d4261b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Request method failure captured: Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed HTTP/1.1 Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqf-r6N4foMJuutu2sNAc27dMG4j4sMfGSN5HXKLCQIRoYj5qzh184gfmaLJyYfMs2LRcMVLz9UlfaNi_MO3BWE643SM4qdChJh0CloXr9P6kUr5Owx3SWe6HA4HKN_tdtWZVtmt3V8pInD4SxOWURcg8J1K0vHP5oxMTMmw5qRr-0_A Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Openstack-Nova-Api-Version: 2.20 Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:02:00.484940 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9e7b007aaf80436f8fa691a12a95f21e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9e7b007aaf80436f8fa691a12a95f21e", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 9e7b007aaf80436f8fa691a12a95f21e Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2085362095 Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 3af6df3efbb74db4958654503e17d82e Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2085362095-project Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 16:02:00.486599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': 'c8ff33fe-05bf-4bd5-9159-69805bae0aed'} Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:02:00.487508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. Jun 15 16:02:00.488727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:02:00.489865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bf712032-d7e3-4cca-8150-391821d4261b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] Returning 404 to user: Instance c8ff33fe-05bf-4bd5-9159-69805bae0aed could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:02:00.489865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bf712032-d7e3-4cca-8150-391821d4261b tempest-AttachVolumeShelveTestJSON-2085362095 tempest-AttachVolumeShelveTestJSON-2085362095-project] 10.222.0.62 "GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed" status: 404 len: 111 microversion: 2.20 time: 0.033692 Jun 15 16:02:00.490543 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 541/1058] 10.222.0.62 () {60 vars in 1276 bytes} [Wed Jun 15 16:02:00 2022] GET /compute/v2.1/servers/c8ff33fe-05bf-4bd5-9159-69805bae0aed => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 15 16:02:01.411163 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7bd1016b-9040-4739-938e-aea09103f76b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:01.412814 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7bd1016b-9040-4739-938e-aea09103f76b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:01.427127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7bd1016b-9040-4739-938e-aea09103f76b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:01.427944 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7bd1016b-9040-4739-938e-aea09103f76b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:01.430164 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7bd1016b-9040-4739-938e-aea09103f76b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:01.440277 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7bd1016b-9040-4739-938e-aea09103f76b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:01.496546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b41d1a03-4ddd-4478-aa70-482a21152127 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:01.497158 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b41d1a03-4ddd-4478-aa70-482a21152127 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:01.505013 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b41d1a03-4ddd-4478-aa70-482a21152127 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:01.505680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b41d1a03-4ddd-4478-aa70-482a21152127 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:01.506680 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b41d1a03-4ddd-4478-aa70-482a21152127 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:01.507401 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b41d1a03-4ddd-4478-aa70-482a21152127 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:01.568519 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:02.009253 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7bd1016b-9040-4739-938e-aea09103f76b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:02.020484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7bd1016b-9040-4739-938e-aea09103f76b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1318 microversion: 2.1 time: 0.613543 Jun 15 16:02:02.022095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 518/1059] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:01 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1318 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:02.152531 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b41d1a03-4ddd-4478-aa70-482a21152127 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:02.160686 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b41d1a03-4ddd-4478-aa70-482a21152127 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.668065 Jun 15 16:02:02.176885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 542/1060] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:01 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:03.041602 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f5e3087f-397c-4426-a46d-231746464166 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:03.042265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f5e3087f-397c-4426-a46d-231746464166 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:03.058614 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f5e3087f-397c-4426-a46d-231746464166 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:03.059158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f5e3087f-397c-4426-a46d-231746464166 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:03.062411 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f5e3087f-397c-4426-a46d-231746464166 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:03.062908 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f5e3087f-397c-4426-a46d-231746464166 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:03.184100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5761b3ab-8184-42fe-9be2-45c742decb0b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:03.184877 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5761b3ab-8184-42fe-9be2-45c742decb0b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:03.192676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5761b3ab-8184-42fe-9be2-45c742decb0b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:03.204926 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5761b3ab-8184-42fe-9be2-45c742decb0b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:03.205927 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5761b3ab-8184-42fe-9be2-45c742decb0b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:03.207288 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5761b3ab-8184-42fe-9be2-45c742decb0b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:03.719194 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f5e3087f-397c-4426-a46d-231746464166 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:03.727426 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f5e3087f-397c-4426-a46d-231746464166 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.691417 Jun 15 16:02:03.729465 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 519/1061] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:03 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:03.886890 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5761b3ab-8184-42fe-9be2-45c742decb0b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:03.900409 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5761b3ab-8184-42fe-9be2-45c742decb0b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.720025 Jun 15 16:02:03.911881 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 543/1062] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:03 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:04.745715 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c024e967-e797-434a-8841-0cad96cc97c7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:04.746324 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c024e967-e797-434a-8841-0cad96cc97c7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:04.753698 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c024e967-e797-434a-8841-0cad96cc97c7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:04.754360 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c024e967-e797-434a-8841-0cad96cc97c7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:04.755507 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c024e967-e797-434a-8841-0cad96cc97c7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:04.757351 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c024e967-e797-434a-8841-0cad96cc97c7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:04.791326 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:04.918439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4abc62d0-5ffe-40ce-9e66-07b77efd9d3e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:04.919201 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4abc62d0-5ffe-40ce-9e66-07b77efd9d3e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:04.927979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4abc62d0-5ffe-40ce-9e66-07b77efd9d3e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:04.933961 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4abc62d0-5ffe-40ce-9e66-07b77efd9d3e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:04.936074 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4abc62d0-5ffe-40ce-9e66-07b77efd9d3e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:04.937837 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4abc62d0-5ffe-40ce-9e66-07b77efd9d3e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:05.106219 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c024e967-e797-434a-8841-0cad96cc97c7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:05.124036 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c024e967-e797-434a-8841-0cad96cc97c7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.381373 Jun 15 16:02:05.124726 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 520/1063] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:04 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:05.267499 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4abc62d0-5ffe-40ce-9e66-07b77efd9d3e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:05.276599 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4abc62d0-5ffe-40ce-9e66-07b77efd9d3e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.362093 Jun 15 16:02:05.277187 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 544/1064] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:04 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:06.142869 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0a1b4fc6-6ea2-4879-896c-6f38f12b5ac6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:06.145153 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0a1b4fc6-6ea2-4879-896c-6f38f12b5ac6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:06.157392 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0a1b4fc6-6ea2-4879-896c-6f38f12b5ac6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:06.158594 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0a1b4fc6-6ea2-4879-896c-6f38f12b5ac6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:06.159621 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0a1b4fc6-6ea2-4879-896c-6f38f12b5ac6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:06.160215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0a1b4fc6-6ea2-4879-896c-6f38f12b5ac6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:06.294587 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6090c764-fc13-4533-8dfb-e60de737951e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:06.295832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6090c764-fc13-4533-8dfb-e60de737951e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:06.307804 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6090c764-fc13-4533-8dfb-e60de737951e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:06.308452 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6090c764-fc13-4533-8dfb-e60de737951e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:06.311785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6090c764-fc13-4533-8dfb-e60de737951e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:06.312421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6090c764-fc13-4533-8dfb-e60de737951e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:06.580685 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0a1b4fc6-6ea2-4879-896c-6f38f12b5ac6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:06.591155 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0a1b4fc6-6ea2-4879-896c-6f38f12b5ac6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.452458 Jun 15 16:02:06.594157 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 521/1065] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:06 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:06.728787 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6090c764-fc13-4533-8dfb-e60de737951e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:06.743872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6090c764-fc13-4533-8dfb-e60de737951e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.452830 Jun 15 16:02:06.761317 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 545/1066] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:06 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:07.098780 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-b8a15d9d-0387-4ee3-99f4-8b06a04ed6b3 req-8efb6c0b-9988-4e95-84fa-48fdd964f1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb374577-499a-4884-a273-19186d6de2bb", "tag": "adfa59bb-5cd2-4c3e-88cb-ec3adc25d982"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:02:07.112221 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-b8a15d9d-0387-4ee3-99f4-8b06a04ed6b3 req-8efb6c0b-9988-4e95-84fa-48fdd964f1e6 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:07.112966 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-b8a15d9d-0387-4ee3-99f4-8b06a04ed6b3 req-8efb6c0b-9988-4e95-84fa-48fdd964f1e6 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:07.145189 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-b8a15d9d-0387-4ee3-99f4-8b06a04ed6b3 req-8efb6c0b-9988-4e95-84fa-48fdd964f1e6 service nova] Creating event network-changed:adfa59bb-5cd2-4c3e-88cb-ec3adc25d982 for instance bb374577-499a-4884-a273-19186d6de2bb on hv-cinder-84599 Jun 15 16:02:07.155434 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-b8a15d9d-0387-4ee3-99f4-8b06a04ed6b3 req-8efb6c0b-9988-4e95-84fa-48fdd964f1e6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061330 Jun 15 16:02:07.156943 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 522/1067] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:02:07.615244 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6b4804f0-b877-4846-8482-b28aa46f00ec tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:07.617254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6b4804f0-b877-4846-8482-b28aa46f00ec tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:07.626023 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6b4804f0-b877-4846-8482-b28aa46f00ec tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:07.626847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6b4804f0-b877-4846-8482-b28aa46f00ec tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:07.634921 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6b4804f0-b877-4846-8482-b28aa46f00ec tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:07.635456 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6b4804f0-b877-4846-8482-b28aa46f00ec tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:07.783348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-23d051cf-88e1-409e-a629-504692bc6c26 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:07.783934 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-23d051cf-88e1-409e-a629-504692bc6c26 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:07.800260 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23d051cf-88e1-409e-a629-504692bc6c26 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:07.801358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23d051cf-88e1-409e-a629-504692bc6c26 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:07.802161 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23d051cf-88e1-409e-a629-504692bc6c26 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:07.807091 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-23d051cf-88e1-409e-a629-504692bc6c26 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:08.009866 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6b4804f0-b877-4846-8482-b28aa46f00ec tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:08.028432 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6b4804f0-b877-4846-8482-b28aa46f00ec tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.418624 Jun 15 16:02:08.029018 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 546/1068] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:07 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:08.131201 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-23d051cf-88e1-409e-a629-504692bc6c26 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:08.151014 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-23d051cf-88e1-409e-a629-504692bc6c26 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.372615 Jun 15 16:02:08.153348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 523/1069] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:07 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:09.049164 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7f2897b6-ec62-4270-a4dd-954dbfde393f tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:09.050647 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7f2897b6-ec62-4270-a4dd-954dbfde393f tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:09.070944 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7f2897b6-ec62-4270-a4dd-954dbfde393f tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:09.072538 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7f2897b6-ec62-4270-a4dd-954dbfde393f tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:09.074508 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7f2897b6-ec62-4270-a4dd-954dbfde393f tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:09.076095 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7f2897b6-ec62-4270-a4dd-954dbfde393f tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:09.171592 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-22fc652c-f504-4ab3-8e0f-a4402f4accf8 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:09.172945 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-22fc652c-f504-4ab3-8e0f-a4402f4accf8 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:09.180692 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-22fc652c-f504-4ab3-8e0f-a4402f4accf8 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:09.186479 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-22fc652c-f504-4ab3-8e0f-a4402f4accf8 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:09.187500 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-22fc652c-f504-4ab3-8e0f-a4402f4accf8 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:09.190340 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-22fc652c-f504-4ab3-8e0f-a4402f4accf8 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:09.234439 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=10 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:09.545716 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7f2897b6-ec62-4270-a4dd-954dbfde393f tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:09.557996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7f2897b6-ec62-4270-a4dd-954dbfde393f tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.511809 Jun 15 16:02:09.558529 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 547/1070] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:09 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:09.585483 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-22fc652c-f504-4ab3-8e0f-a4402f4accf8 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:09.600340 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-22fc652c-f504-4ab3-8e0f-a4402f4accf8 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.433452 Jun 15 16:02:09.604827 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 524/1071] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:09 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:10.592138 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ca2c5921-41ca-485a-9040-0b7933fec34d tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:10.592138 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ca2c5921-41ca-485a-9040-0b7933fec34d tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:10.599144 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:10.611406 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=10 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:10.613292 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ca2c5921-41ca-485a-9040-0b7933fec34d tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:10.615935 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ca2c5921-41ca-485a-9040-0b7933fec34d tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:10.619043 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ca2c5921-41ca-485a-9040-0b7933fec34d tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:10.621119 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b1ab11d2-4944-4a11-a8ea-f3d0c0dc7e72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:10.621922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b1ab11d2-4944-4a11-a8ea-f3d0c0dc7e72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:10.623344 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ca2c5921-41ca-485a-9040-0b7933fec34d tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:10.624374 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:10.644629 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b1ab11d2-4944-4a11-a8ea-f3d0c0dc7e72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:10.645082 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b1ab11d2-4944-4a11-a8ea-f3d0c0dc7e72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:10.645895 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b1ab11d2-4944-4a11-a8ea-f3d0c0dc7e72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:10.646315 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b1ab11d2-4944-4a11-a8ea-f3d0c0dc7e72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:10.948457 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ca2c5921-41ca-485a-9040-0b7933fec34d tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:10.958836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ca2c5921-41ca-485a-9040-0b7933fec34d tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.382812 Jun 15 16:02:10.963065 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 548/1072] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:10 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:10.992398 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b1ab11d2-4944-4a11-a8ea-f3d0c0dc7e72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:11.003180 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b1ab11d2-4944-4a11-a8ea-f3d0c0dc7e72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.385765 Jun 15 16:02:11.012083 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 525/1073] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:10 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:11.755067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-62c52ef4-e952-43a2-a0f2-9f42c3c1b414 req-863e8f83-c232-41ab-9b75-6bfa12c7c03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e337762-1c2f-446b-b266-8a491f6f3a94", "name": "network-vif-plugged", "status": "completed", "tag": "d34c8693-5e99-46b1-adfb-f3f6cf283ae7"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:02:11.767757 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-62c52ef4-e952-43a2-a0f2-9f42c3c1b414 req-863e8f83-c232-41ab-9b75-6bfa12c7c03e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:11.769817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-62c52ef4-e952-43a2-a0f2-9f42c3c1b414 req-863e8f83-c232-41ab-9b75-6bfa12c7c03e service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:11.786376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-62c52ef4-e952-43a2-a0f2-9f42c3c1b414 req-863e8f83-c232-41ab-9b75-6bfa12c7c03e service nova] Creating event network-vif-plugged:d34c8693-5e99-46b1-adfb-f3f6cf283ae7 for instance 6e337762-1c2f-446b-b266-8a491f6f3a94 on hv-cinder-84599 Jun 15 16:02:11.794243 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-62c52ef4-e952-43a2-a0f2-9f42c3c1b414 req-863e8f83-c232-41ab-9b75-6bfa12c7c03e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252109 Jun 15 16:02:11.794857 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 549/1074] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:02:11.976898 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a449f376-c8b6-4b1b-b61a-0affd3d77136 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:11.978435 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a449f376-c8b6-4b1b-b61a-0affd3d77136 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:11.985462 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a449f376-c8b6-4b1b-b61a-0affd3d77136 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:11.985919 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a449f376-c8b6-4b1b-b61a-0affd3d77136 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:11.986694 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a449f376-c8b6-4b1b-b61a-0affd3d77136 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:11.987158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a449f376-c8b6-4b1b-b61a-0affd3d77136 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:12.030317 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f55872b6-07be-4395-9b36-b7e27bda6f5f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:12.031498 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f55872b6-07be-4395-9b36-b7e27bda6f5f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:12.039797 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f55872b6-07be-4395-9b36-b7e27bda6f5f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:12.040631 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f55872b6-07be-4395-9b36-b7e27bda6f5f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:12.041582 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f55872b6-07be-4395-9b36-b7e27bda6f5f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:12.042201 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-f55872b6-07be-4395-9b36-b7e27bda6f5f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:12.203104 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a449f376-c8b6-4b1b-b61a-0affd3d77136 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:12.212614 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a449f376-c8b6-4b1b-b61a-0affd3d77136 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.240301 Jun 15 16:02:12.213759 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 526/1075] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:11 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:12.261827 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f55872b6-07be-4395-9b36-b7e27bda6f5f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:12.269829 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f55872b6-07be-4395-9b36-b7e27bda6f5f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.245059 Jun 15 16:02:12.270828 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 550/1076] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:12 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:13.229705 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1177a5c4-9c54-4cf2-8131-a845fd293647 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:13.230332 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1177a5c4-9c54-4cf2-8131-a845fd293647 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:13.236943 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1177a5c4-9c54-4cf2-8131-a845fd293647 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:13.237578 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1177a5c4-9c54-4cf2-8131-a845fd293647 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:13.238537 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1177a5c4-9c54-4cf2-8131-a845fd293647 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:13.239007 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1177a5c4-9c54-4cf2-8131-a845fd293647 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:13.287193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0f72a80b-85ba-429f-931d-1b11a20b3d31 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:13.288612 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0f72a80b-85ba-429f-931d-1b11a20b3d31 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:13.295031 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0f72a80b-85ba-429f-931d-1b11a20b3d31 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:13.299383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0f72a80b-85ba-429f-931d-1b11a20b3d31 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:13.300793 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0f72a80b-85ba-429f-931d-1b11a20b3d31 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:13.301947 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0f72a80b-85ba-429f-931d-1b11a20b3d31 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:13.466169 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1177a5c4-9c54-4cf2-8131-a845fd293647 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:13.477984 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1177a5c4-9c54-4cf2-8131-a845fd293647 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.252503 Jun 15 16:02:13.478690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 527/1077] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:13 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:13.495493 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0f72a80b-85ba-429f-931d-1b11a20b3d31 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:13.504096 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0f72a80b-85ba-429f-931d-1b11a20b3d31 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.220752 Jun 15 16:02:13.504801 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 551/1078] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:13 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:14.494953 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a6a44679-b7ed-4a65-b56c-96502a934bc5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:14.496268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a6a44679-b7ed-4a65-b56c-96502a934bc5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:14.503938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a6a44679-b7ed-4a65-b56c-96502a934bc5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:14.504668 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a6a44679-b7ed-4a65-b56c-96502a934bc5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:14.505926 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a6a44679-b7ed-4a65-b56c-96502a934bc5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:14.506632 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a6a44679-b7ed-4a65-b56c-96502a934bc5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:14.521218 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8305edec-c37c-4463-9498-e631e91aaed0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:14.521826 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8305edec-c37c-4463-9498-e631e91aaed0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:14.532758 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8305edec-c37c-4463-9498-e631e91aaed0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:14.533254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8305edec-c37c-4463-9498-e631e91aaed0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:14.534142 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8305edec-c37c-4463-9498-e631e91aaed0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:14.534607 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8305edec-c37c-4463-9498-e631e91aaed0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:14.766983 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a6a44679-b7ed-4a65-b56c-96502a934bc5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:14.771994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8305edec-c37c-4463-9498-e631e91aaed0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:14.776091 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a6a44679-b7ed-4a65-b56c-96502a934bc5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.285314 Jun 15 16:02:14.777030 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 528/1079] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:14 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:14.787136 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8305edec-c37c-4463-9498-e631e91aaed0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.269870 Jun 15 16:02:14.787999 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 552/1080] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:14 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:15.795518 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1ba639fa-3345-4ffd-ae63-9c12437975d4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:15.797459 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1ba639fa-3345-4ffd-ae63-9c12437975d4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:15.805150 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4148feac-f356-4fd9-8af9-50392dbf15d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:15.806620 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4148feac-f356-4fd9-8af9-50392dbf15d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:15.811717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1ba639fa-3345-4ffd-ae63-9c12437975d4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:15.812183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1ba639fa-3345-4ffd-ae63-9c12437975d4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:15.813221 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1ba639fa-3345-4ffd-ae63-9c12437975d4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:15.814080 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1ba639fa-3345-4ffd-ae63-9c12437975d4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:15.815382 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4148feac-f356-4fd9-8af9-50392dbf15d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:15.816004 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4148feac-f356-4fd9-8af9-50392dbf15d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:15.816919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4148feac-f356-4fd9-8af9-50392dbf15d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:15.817645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4148feac-f356-4fd9-8af9-50392dbf15d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:16.115669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1ba639fa-3345-4ffd-ae63-9c12437975d4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:16.122585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4148feac-f356-4fd9-8af9-50392dbf15d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:16.124818 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=100 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:16.131164 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1ba639fa-3345-4ffd-ae63-9c12437975d4 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.341044 Jun 15 16:02:16.145811 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4148feac-f356-4fd9-8af9-50392dbf15d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.345140 Jun 15 16:02:16.146754 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 529/1081] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:15 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:16.146923 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 553/1082] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:15 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:17.148595 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-1b12f65a-06be-43e6-bec8-0e6ef0e339ac tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:17.149211 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-1b12f65a-06be-43e6-bec8-0e6ef0e339ac tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:17.155787 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1b12f65a-06be-43e6-bec8-0e6ef0e339ac tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:17.156270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1b12f65a-06be-43e6-bec8-0e6ef0e339ac tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:17.157046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1b12f65a-06be-43e6-bec8-0e6ef0e339ac tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:17.157849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-1b12f65a-06be-43e6-bec8-0e6ef0e339ac tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:17.163319 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6358bfc2-bb96-4e74-9b0b-9cb326c85027 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:17.164507 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6358bfc2-bb96-4e74-9b0b-9cb326c85027 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:17.171716 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6358bfc2-bb96-4e74-9b0b-9cb326c85027 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:17.172247 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6358bfc2-bb96-4e74-9b0b-9cb326c85027 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:17.173332 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6358bfc2-bb96-4e74-9b0b-9cb326c85027 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:17.173792 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6358bfc2-bb96-4e74-9b0b-9cb326c85027 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:17.360196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-1b12f65a-06be-43e6-bec8-0e6ef0e339ac tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:17.364844 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-6358bfc2-bb96-4e74-9b0b-9cb326c85027 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:17.369047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-1b12f65a-06be-43e6-bec8-0e6ef0e339ac tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.224870 Jun 15 16:02:17.369620 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 530/1083] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:17 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:17.373765 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6358bfc2-bb96-4e74-9b0b-9cb326c85027 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.214780 Jun 15 16:02:17.374521 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 554/1084] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:17 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:18.385379 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-30df2678-c2a5-47bf-9bb7-a45467b4a0e7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:18.385993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-30df2678-c2a5-47bf-9bb7-a45467b4a0e7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:18.391385 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-bdc0820a-948a-4066-9e55-6a3a6fb1dd79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:18.392676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-bdc0820a-948a-4066-9e55-6a3a6fb1dd79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:18.393832 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-30df2678-c2a5-47bf-9bb7-a45467b4a0e7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:18.394492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-30df2678-c2a5-47bf-9bb7-a45467b4a0e7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:18.395285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-30df2678-c2a5-47bf-9bb7-a45467b4a0e7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:18.395982 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-30df2678-c2a5-47bf-9bb7-a45467b4a0e7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:18.400452 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bdc0820a-948a-4066-9e55-6a3a6fb1dd79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:18.401064 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bdc0820a-948a-4066-9e55-6a3a6fb1dd79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:18.401832 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bdc0820a-948a-4066-9e55-6a3a6fb1dd79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:18.402269 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-bdc0820a-948a-4066-9e55-6a3a6fb1dd79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:18.867127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-30df2678-c2a5-47bf-9bb7-a45467b4a0e7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:18.869029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-bdc0820a-948a-4066-9e55-6a3a6fb1dd79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:18.875509 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-30df2678-c2a5-47bf-9bb7-a45467b4a0e7 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.493941 Jun 15 16:02:18.876405 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 531/1085] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:18 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:18.876962 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-bdc0820a-948a-4066-9e55-6a3a6fb1dd79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.489360 Jun 15 16:02:18.877615 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 555/1086] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:18 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:19.893368 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4a5fe3a2-1b25-461d-807e-0d108f5d67ea tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:19.894003 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4a5fe3a2-1b25-461d-807e-0d108f5d67ea tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:19.894847 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2548b786-2b86-4689-b95a-4ec92988c47c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:19.895475 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2548b786-2b86-4689-b95a-4ec92988c47c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:19.901353 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a5fe3a2-1b25-461d-807e-0d108f5d67ea tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:19.901802 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a5fe3a2-1b25-461d-807e-0d108f5d67ea tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:19.902568 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a5fe3a2-1b25-461d-807e-0d108f5d67ea tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:19.902850 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2548b786-2b86-4689-b95a-4ec92988c47c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:19.903068 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a5fe3a2-1b25-461d-807e-0d108f5d67ea tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:19.903303 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2548b786-2b86-4689-b95a-4ec92988c47c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:19.904064 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2548b786-2b86-4689-b95a-4ec92988c47c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:19.904521 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2548b786-2b86-4689-b95a-4ec92988c47c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:20.107646 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4a5fe3a2-1b25-461d-807e-0d108f5d67ea tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:20.115041 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2548b786-2b86-4689-b95a-4ec92988c47c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:20.123208 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2548b786-2b86-4689-b95a-4ec92988c47c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.232223 Jun 15 16:02:20.124148 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 532/1087] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:19 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:20.133383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4a5fe3a2-1b25-461d-807e-0d108f5d67ea tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.243948 Jun 15 16:02:20.133978 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 556/1088] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:19 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:21.141522 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-549987d8-5220-4d3f-82df-9c8cb700ffde tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:21.142287 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-549987d8-5220-4d3f-82df-9c8cb700ffde tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:21.149237 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-74052b60-697d-4954-8dce-8467e67fea45 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:21.149975 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-74052b60-697d-4954-8dce-8467e67fea45 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:21.150098 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-549987d8-5220-4d3f-82df-9c8cb700ffde tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:21.150451 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-549987d8-5220-4d3f-82df-9c8cb700ffde tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:21.151258 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-549987d8-5220-4d3f-82df-9c8cb700ffde tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:21.151733 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-549987d8-5220-4d3f-82df-9c8cb700ffde tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:21.156577 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-74052b60-697d-4954-8dce-8467e67fea45 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:21.157227 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-74052b60-697d-4954-8dce-8467e67fea45 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:21.158168 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-74052b60-697d-4954-8dce-8467e67fea45 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:21.158604 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-74052b60-697d-4954-8dce-8467e67fea45 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:21.447601 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-549987d8-5220-4d3f-82df-9c8cb700ffde tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:21.455548 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-74052b60-697d-4954-8dce-8467e67fea45 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:21.457254 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-549987d8-5220-4d3f-82df-9c8cb700ffde tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.319693 Jun 15 16:02:21.463124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-74052b60-697d-4954-8dce-8467e67fea45 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.317460 Jun 15 16:02:21.463860 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 557/1089] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:21 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:21.466752 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 533/1090] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:21 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:22.473816 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4052be95-45af-49d2-a6c3-dcf18bd37979 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:22.474724 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4052be95-45af-49d2-a6c3-dcf18bd37979 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:22.479380 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b63e48bd-879d-4346-a796-78b890323acc tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:22.480121 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b63e48bd-879d-4346-a796-78b890323acc tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:22.481393 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4052be95-45af-49d2-a6c3-dcf18bd37979 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:22.481841 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4052be95-45af-49d2-a6c3-dcf18bd37979 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:22.482601 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4052be95-45af-49d2-a6c3-dcf18bd37979 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:22.483061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4052be95-45af-49d2-a6c3-dcf18bd37979 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:22.486721 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b63e48bd-879d-4346-a796-78b890323acc tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:22.487246 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b63e48bd-879d-4346-a796-78b890323acc tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:22.488019 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b63e48bd-879d-4346-a796-78b890323acc tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:22.488460 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b63e48bd-879d-4346-a796-78b890323acc tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:22.678167 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4052be95-45af-49d2-a6c3-dcf18bd37979 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:22.682330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b63e48bd-879d-4346-a796-78b890323acc tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:22.685666 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4052be95-45af-49d2-a6c3-dcf18bd37979 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.215813 Jun 15 16:02:22.686228 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 558/1091] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:22 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:22.689909 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b63e48bd-879d-4346-a796-78b890323acc tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.214305 Jun 15 16:02:22.690551 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 534/1092] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:22 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:23.701467 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ba6ac4bc-c0e8-4687-a4da-6730b5456a64 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:23.702065 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ba6ac4bc-c0e8-4687-a4da-6730b5456a64 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:23.704352 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:23.706233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-81866675-a644-4aa3-8c98-c1f990c9fd44 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:23.706884 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-81866675-a644-4aa3-8c98-c1f990c9fd44 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:23.709745 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ba6ac4bc-c0e8-4687-a4da-6730b5456a64 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:23.710187 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ba6ac4bc-c0e8-4687-a4da-6730b5456a64 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:23.710973 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ba6ac4bc-c0e8-4687-a4da-6730b5456a64 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:23.711396 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ba6ac4bc-c0e8-4687-a4da-6730b5456a64 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:23.713504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-81866675-a644-4aa3-8c98-c1f990c9fd44 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:23.713959 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-81866675-a644-4aa3-8c98-c1f990c9fd44 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:23.714755 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-81866675-a644-4aa3-8c98-c1f990c9fd44 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:23.715197 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-81866675-a644-4aa3-8c98-c1f990c9fd44 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:23.903093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-81866675-a644-4aa3-8c98-c1f990c9fd44 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:23.910698 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-81866675-a644-4aa3-8c98-c1f990c9fd44 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.208267 Jun 15 16:02:23.911302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 535/1093] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:23 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:23.911465 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ba6ac4bc-c0e8-4687-a4da-6730b5456a64 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:23.919676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ba6ac4bc-c0e8-4687-a4da-6730b5456a64 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1265 microversion: 2.1 time: 0.222042 Jun 15 16:02:23.920224 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 559/1094] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:23 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:24.927964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e9dafcc6-c935-4641-a90e-e1a68b1fb5ce tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:24.928504 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e9dafcc6-c935-4641-a90e-e1a68b1fb5ce tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:24.935511 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e9dafcc6-c935-4641-a90e-e1a68b1fb5ce tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:24.935805 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2d3c25d7-aeb0-4081-a043-6348caffe87c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:24.936289 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e9dafcc6-c935-4641-a90e-e1a68b1fb5ce tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:24.936447 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2d3c25d7-aeb0-4081-a043-6348caffe87c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:24.936714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e9dafcc6-c935-4641-a90e-e1a68b1fb5ce tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:24.937155 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e9dafcc6-c935-4641-a90e-e1a68b1fb5ce tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:24.943010 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2d3c25d7-aeb0-4081-a043-6348caffe87c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:24.943464 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2d3c25d7-aeb0-4081-a043-6348caffe87c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:24.944227 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2d3c25d7-aeb0-4081-a043-6348caffe87c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:24.945313 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2d3c25d7-aeb0-4081-a043-6348caffe87c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:25.128602 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e9dafcc6-c935-4641-a90e-e1a68b1fb5ce tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:25.133633 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2d3c25d7-aeb0-4081-a043-6348caffe87c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:25.138348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e9dafcc6-c935-4641-a90e-e1a68b1fb5ce tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.213947 Jun 15 16:02:25.139307 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 536/1095] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:24 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:25.141288 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2d3c25d7-aeb0-4081-a043-6348caffe87c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1450 microversion: 2.1 time: 0.209354 Jun 15 16:02:25.141842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 560/1096] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:24 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1450 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:02:25.157292 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-11a05a87-43c7-41f4-8093-fbae9a456efb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:25.157896 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-11a05a87-43c7-41f4-8093-fbae9a456efb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:25.164205 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-11a05a87-43c7-41f4-8093-fbae9a456efb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:25.164656 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-11a05a87-43c7-41f4-8093-fbae9a456efb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:25.165411 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-11a05a87-43c7-41f4-8093-fbae9a456efb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:25.165846 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-11a05a87-43c7-41f4-8093-fbae9a456efb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:25.300130 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-11a05a87-43c7-41f4-8093-fbae9a456efb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:25.303594 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=100 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:25.309281 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-11a05a87-43c7-41f4-8093-fbae9a456efb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1450 microversion: 2.1 time: 0.155554 Jun 15 16:02:25.309821 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 537/1097] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:25 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:26.155959 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3a13844a-38d8-4226-a635-c5b14dd3d530 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:26.157600 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3a13844a-38d8-4226-a635-c5b14dd3d530 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:26.164947 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3a13844a-38d8-4226-a635-c5b14dd3d530 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:26.165383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3a13844a-38d8-4226-a635-c5b14dd3d530 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:26.166172 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3a13844a-38d8-4226-a635-c5b14dd3d530 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:26.166600 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3a13844a-38d8-4226-a635-c5b14dd3d530 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:26.407122 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3a13844a-38d8-4226-a635-c5b14dd3d530 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:26.414779 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3a13844a-38d8-4226-a635-c5b14dd3d530 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.262778 Jun 15 16:02:26.415345 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 561/1098] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:26 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:27.122990 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-c1f7d3f8-7a86-4970-a7fa-5aadbab56ede req-a295fb97-b76d-406b-b23a-b675c4643aff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e337762-1c2f-446b-b266-8a491f6f3a94", "tag": "d34c8693-5e99-46b1-adfb-f3f6cf283ae7"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:02:27.131556 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-c1f7d3f8-7a86-4970-a7fa-5aadbab56ede req-a295fb97-b76d-406b-b23a-b675c4643aff service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:27.132042 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-c1f7d3f8-7a86-4970-a7fa-5aadbab56ede req-a295fb97-b76d-406b-b23a-b675c4643aff service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:27.143421 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-c1f7d3f8-7a86-4970-a7fa-5aadbab56ede req-a295fb97-b76d-406b-b23a-b675c4643aff service nova] Creating event network-changed:d34c8693-5e99-46b1-adfb-f3f6cf283ae7 for instance 6e337762-1c2f-446b-b266-8a491f6f3a94 on hv-cinder-84599 Jun 15 16:02:27.149242 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-c1f7d3f8-7a86-4970-a7fa-5aadbab56ede req-a295fb97-b76d-406b-b23a-b675c4643aff service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029912 Jun 15 16:02:27.150359 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 538/1099] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:02:27.432525 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-b54beae1-9912-4449-80ee-ec460a7b54e6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:27.433139 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-b54beae1-9912-4449-80ee-ec460a7b54e6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:27.439687 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b54beae1-9912-4449-80ee-ec460a7b54e6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:27.440143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b54beae1-9912-4449-80ee-ec460a7b54e6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:27.441025 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b54beae1-9912-4449-80ee-ec460a7b54e6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:27.441468 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-b54beae1-9912-4449-80ee-ec460a7b54e6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:27.570978 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-b54beae1-9912-4449-80ee-ec460a7b54e6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:27.578350 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-b54beae1-9912-4449-80ee-ec460a7b54e6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.149723 Jun 15 16:02:27.578954 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 562/1100] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:27 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:28.596574 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-32dbfbbf-e7d3-4770-9e1f-6204aeed3478 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:28.597266 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-32dbfbbf-e7d3-4770-9e1f-6204aeed3478 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:28.603989 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32dbfbbf-e7d3-4770-9e1f-6204aeed3478 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:28.604423 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32dbfbbf-e7d3-4770-9e1f-6204aeed3478 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:28.605166 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32dbfbbf-e7d3-4770-9e1f-6204aeed3478 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:28.605593 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32dbfbbf-e7d3-4770-9e1f-6204aeed3478 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:28.735851 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-32dbfbbf-e7d3-4770-9e1f-6204aeed3478 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:28.743191 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-32dbfbbf-e7d3-4770-9e1f-6204aeed3478 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.151321 Jun 15 16:02:28.743757 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 539/1101] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:28 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:29.135126 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-60bb48b5-2fd3-4f12-a9a4-7fe21e98cf88 req-fff9b508-183b-49d6-b87f-a9e2d7a5b0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb374577-499a-4884-a273-19186d6de2bb", "name": "network-vif-plugged", "status": "completed", "tag": "adfa59bb-5cd2-4c3e-88cb-ec3adc25d982"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:02:29.145569 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-60bb48b5-2fd3-4f12-a9a4-7fe21e98cf88 req-fff9b508-183b-49d6-b87f-a9e2d7a5b0aa service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:29.146275 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-60bb48b5-2fd3-4f12-a9a4-7fe21e98cf88 req-fff9b508-183b-49d6-b87f-a9e2d7a5b0aa service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:29.159309 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-60bb48b5-2fd3-4f12-a9a4-7fe21e98cf88 req-fff9b508-183b-49d6-b87f-a9e2d7a5b0aa service nova] Creating event network-vif-plugged:adfa59bb-5cd2-4c3e-88cb-ec3adc25d982 for instance bb374577-499a-4884-a273-19186d6de2bb on hv-cinder-84599 Jun 15 16:02:29.164869 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-60bb48b5-2fd3-4f12-a9a4-7fe21e98cf88 req-fff9b508-183b-49d6-b87f-a9e2d7a5b0aa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035682 Jun 15 16:02:29.165470 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 563/1102] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:02:29.759919 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-204add51-e66d-4c47-aed7-4370071ca367 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:29.760524 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-204add51-e66d-4c47-aed7-4370071ca367 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:29.767002 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-204add51-e66d-4c47-aed7-4370071ca367 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:29.767440 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-204add51-e66d-4c47-aed7-4370071ca367 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:29.768187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-204add51-e66d-4c47-aed7-4370071ca367 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:29.768615 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-204add51-e66d-4c47-aed7-4370071ca367 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:29.896020 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-204add51-e66d-4c47-aed7-4370071ca367 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:29.905022 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-204add51-e66d-4c47-aed7-4370071ca367 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.149447 Jun 15 16:02:29.905585 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 540/1103] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:29 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:30.923088 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5e010d97-5bfc-4573-82a3-9e50df7ba550 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:30.923797 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5e010d97-5bfc-4573-82a3-9e50df7ba550 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:30.929948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5e010d97-5bfc-4573-82a3-9e50df7ba550 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:30.930393 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5e010d97-5bfc-4573-82a3-9e50df7ba550 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:30.931179 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5e010d97-5bfc-4573-82a3-9e50df7ba550 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:30.931613 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5e010d97-5bfc-4573-82a3-9e50df7ba550 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:31.065154 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5e010d97-5bfc-4573-82a3-9e50df7ba550 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:31.072732 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5e010d97-5bfc-4573-82a3-9e50df7ba550 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.154431 Jun 15 16:02:31.073332 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 564/1104] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:30 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:32.089393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6bcf2f96-81c6-4020-826a-838fe5b40b4e tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:32.090007 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6bcf2f96-81c6-4020-826a-838fe5b40b4e tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:32.096625 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6bcf2f96-81c6-4020-826a-838fe5b40b4e tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:32.097073 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6bcf2f96-81c6-4020-826a-838fe5b40b4e tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:32.097831 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6bcf2f96-81c6-4020-826a-838fe5b40b4e tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:32.098267 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6bcf2f96-81c6-4020-826a-838fe5b40b4e tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:32.231910 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6bcf2f96-81c6-4020-826a-838fe5b40b4e tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:32.239524 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6bcf2f96-81c6-4020-826a-838fe5b40b4e tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1358 microversion: 2.1 time: 0.153988 Jun 15 16:02:32.240126 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 541/1105] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:32 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:33.256458 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a242a877-7a9a-4966-b234-f0ecf544f1fb tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:33.257068 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a242a877-7a9a-4966-b234-f0ecf544f1fb tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:33.264388 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a242a877-7a9a-4966-b234-f0ecf544f1fb tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:33.264836 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a242a877-7a9a-4966-b234-f0ecf544f1fb tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:33.265595 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a242a877-7a9a-4966-b234-f0ecf544f1fb tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:33.266031 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a242a877-7a9a-4966-b234-f0ecf544f1fb tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:33.393698 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a242a877-7a9a-4966-b234-f0ecf544f1fb tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:33.401118 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a242a877-7a9a-4966-b234-f0ecf544f1fb tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1547 microversion: 2.1 time: 0.148578 Jun 15 16:02:33.401675 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 565/1106] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:33 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:33.417197 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-eeaf1b60-d6c8-4842-9ae4-313c185c7bf8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:33.417807 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-eeaf1b60-d6c8-4842-9ae4-313c185c7bf8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:33.429863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eeaf1b60-d6c8-4842-9ae4-313c185c7bf8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:33.430931 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eeaf1b60-d6c8-4842-9ae4-313c185c7bf8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:33.433261 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eeaf1b60-d6c8-4842-9ae4-313c185c7bf8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:33.433709 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eeaf1b60-d6c8-4842-9ae4-313c185c7bf8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:33.562327 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-eeaf1b60-d6c8-4842-9ae4-313c185c7bf8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:33.569837 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-eeaf1b60-d6c8-4842-9ae4-313c185c7bf8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1547 microversion: 2.1 time: 0.156928 Jun 15 16:02:33.570407 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 542/1107] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:33 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:33.585220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-97efd983-16ab-4fe7-bf85-800a9a691b7a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:33.588669 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-97efd983-16ab-4fe7-bf85-800a9a691b7a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:33.589454 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-97efd983-16ab-4fe7-bf85-800a9a691b7a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Searching by: {'deleted': False, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f'} {{(pid=123934) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 15 16:02:33.595990 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-97efd983-16ab-4fe7-bf85-800a9a691b7a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:33.596365 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-97efd983-16ab-4fe7-bf85-800a9a691b7a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:33.597140 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-97efd983-16ab-4fe7-bf85-800a9a691b7a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:33.597638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-97efd983-16ab-4fe7-bf85-800a9a691b7a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:33.689247 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.multi_cell_list [None req-97efd983-16ab-4fe7-bf85-800a9a691b7a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123934) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 15 16:02:33.787075 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-97efd983-16ab-4fe7-bf85-800a9a691b7a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.205502 Jun 15 16:02:33.787650 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 566/1108] 10.222.0.62 () {58 vars in 1124 bytes} [Wed Jun 15 16:02:33 2022] GET /compute/v2.1/servers => generated 343 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:02:33.798796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-50e2f129-5f5a-4507-8daf-f9efa65440df tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:33.799432 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-50e2f129-5f5a-4507-8daf-f9efa65440df tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:33.806296 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-50e2f129-5f5a-4507-8daf-f9efa65440df tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:33.806771 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-50e2f129-5f5a-4507-8daf-f9efa65440df tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:33.807544 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-50e2f129-5f5a-4507-8daf-f9efa65440df tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:33.807979 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-50e2f129-5f5a-4507-8daf-f9efa65440df tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:33.932808 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-50e2f129-5f5a-4507-8daf-f9efa65440df tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:33.945750 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-50e2f129-5f5a-4507-8daf-f9efa65440df tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1547 microversion: 2.1 time: 0.150893 Jun 15 16:02:33.946337 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 543/1109] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:33 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:39.639172 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5242f82a-871d-4961-8271-e0e677ced854 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ddc214e-bfbe-4012-9e71-f3a88ec8207e"}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:02:39.640223 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5242f82a-871d-4961-8271-e0e677ced854 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:39.646719 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5242f82a-871d-4961-8271-e0e677ced854 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:39.647191 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5242f82a-871d-4961-8271-e0e677ced854 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:39.647943 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5242f82a-871d-4961-8271-e0e677ced854 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:39.648374 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5242f82a-871d-4961-8271-e0e677ced854 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:39.934445 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5242f82a-871d-4961-8271-e0e677ced854 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "POST /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298852 Jun 15 16:02:39.935098 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 567/1110] 10.222.0.62 () {60 vars in 1322 bytes} [Wed Jun 15 16:02:39 2022] POST /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:02:55.956024 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f2ffe20e-0fd3-4396-9bbd-a16da6af8613 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:55.956634 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f2ffe20e-0fd3-4396-9bbd-a16da6af8613 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:55.959357 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=37 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:55.960146 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=32 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:55.965558 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f2ffe20e-0fd3-4396-9bbd-a16da6af8613 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:55.966006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f2ffe20e-0fd3-4396-9bbd-a16da6af8613 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:55.966880 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f2ffe20e-0fd3-4396-9bbd-a16da6af8613 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:55.967940 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f2ffe20e-0fd3-4396-9bbd-a16da6af8613 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:56.096529 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-f2ffe20e-0fd3-4396-9bbd-a16da6af8613 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:02:56.104514 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f2ffe20e-0fd3-4396-9bbd-a16da6af8613 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1593 microversion: 2.1 time: 0.152273 Jun 15 16:02:56.105075 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 544/1111] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:55 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:02:58.058357 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:58.059623 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=17 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:58.060286 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:02:58.067004 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-8afec49f-2d62-4dff-8a62-f38286967131 req-2bc2ee3f-5e85-44fb-a686-18915f1a4f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb374577-499a-4884-a273-19186d6de2bb", "tag": "adfa59bb-5cd2-4c3e-88cb-ec3adc25d982"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:02:58.079048 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-8afec49f-2d62-4dff-8a62-f38286967131 req-2bc2ee3f-5e85-44fb-a686-18915f1a4f8a service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:58.079789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-8afec49f-2d62-4dff-8a62-f38286967131 req-2bc2ee3f-5e85-44fb-a686-18915f1a4f8a service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:58.094161 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-8afec49f-2d62-4dff-8a62-f38286967131 req-2bc2ee3f-5e85-44fb-a686-18915f1a4f8a service nova] Creating event network-changed:adfa59bb-5cd2-4c3e-88cb-ec3adc25d982 for instance bb374577-499a-4884-a273-19186d6de2bb on hv-cinder-84599 Jun 15 16:02:58.100203 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-8afec49f-2d62-4dff-8a62-f38286967131 req-2bc2ee3f-5e85-44fb-a686-18915f1a4f8a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043189 Jun 15 16:02:58.104828 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 568/1112] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:02:59.354218 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3136b57e-f835-4d9c-8e61-8b9118fb7ca2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-10013953"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:02:59.355469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3136b57e-f835-4d9c-8e61-8b9118fb7ca2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:02:59.362398 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3136b57e-f835-4d9c-8e61-8b9118fb7ca2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:59.363113 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3136b57e-f835-4d9c-8e61-8b9118fb7ca2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:59.364056 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3136b57e-f835-4d9c-8e61-8b9118fb7ca2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:02:59.364752 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3136b57e-f835-4d9c-8e61-8b9118fb7ca2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:02:59.555539 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.network.security_group_api [None req-3136b57e-f835-4d9c-8e61-8b9118fb7ca2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Adding security group 6addbcce-7496-4315-b163-2f3ef7d12e3d to port adfa59bb-5cd2-4c3e-88cb-ec3adc25d982 Jun 15 16:02:59.977086 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3136b57e-f835-4d9c-8e61-8b9118fb7ca2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "POST /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/action" status: 202 len: 0 microversion: 2.1 time: 0.626699 Jun 15 16:02:59.978512 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 545/1113] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 16:02:59 2022] POST /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:02:59.987807 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7c6e5e1c-456c-48a8-89b2-5e9644a3cb7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:02:59.988606 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7c6e5e1c-456c-48a8-89b2-5e9644a3cb7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:03:00.006440 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c6e5e1c-456c-48a8-89b2-5e9644a3cb7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:03:00.006932 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c6e5e1c-456c-48a8-89b2-5e9644a3cb7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:03:00.007712 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c6e5e1c-456c-48a8-89b2-5e9644a3cb7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:03:00.008643 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7c6e5e1c-456c-48a8-89b2-5e9644a3cb7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:03:00.120656 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-84a12ab6-c515-4d5a-a160-f04cb0d7886c req-703ca049-6cf6-4642-a23f-53082d59f130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb374577-499a-4884-a273-19186d6de2bb", "tag": "adfa59bb-5cd2-4c3e-88cb-ec3adc25d982"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:03:00.140205 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-84a12ab6-c515-4d5a-a160-f04cb0d7886c req-703ca049-6cf6-4642-a23f-53082d59f130 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:03:00.140653 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-84a12ab6-c515-4d5a-a160-f04cb0d7886c req-703ca049-6cf6-4642-a23f-53082d59f130 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:03:00.160942 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-84a12ab6-c515-4d5a-a160-f04cb0d7886c req-703ca049-6cf6-4642-a23f-53082d59f130 service nova] Creating event network-changed:adfa59bb-5cd2-4c3e-88cb-ec3adc25d982 for instance bb374577-499a-4884-a273-19186d6de2bb on hv-cinder-84599 Jun 15 16:03:00.168498 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-84a12ab6-c515-4d5a-a160-f04cb0d7886c req-703ca049-6cf6-4642-a23f-53082d59f130 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052474 Jun 15 16:03:00.169837 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 546/1114] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 16:03:00.336082 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7c6e5e1c-456c-48a8-89b2-5e9644a3cb7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:03:00.376772 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7c6e5e1c-456c-48a8-89b2-5e9644a3cb7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1756 microversion: 2.1 time: 0.393902 Jun 15 16:03:00.390825 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 569/1115] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:02:59 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1756 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:03:32.674977 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=6 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:03:32.676040 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=12 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:03:32.961007 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0e92c854-37b7-4d59-ab88-07577ccade0c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Action: 'create', calling method: .version_select at 0x7fd8d80aa700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1844540297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhxpbUDou4fP4A7T1SaFzyTPAsw8mozIywlH9i+q4MvOcXQrEQntsr86ceEpkVh7bPm8T7tJBHx8NyrPDmn48FUJdHJjfQ8vxqh71+tT8iO1ZOAkIwMElMgZFl25WBHKA=="}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:03:32.977599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-0e92c854-37b7-4d59-ab88-07577ccade0c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Getting quotas for project 202b681b581b4f6ea4fe9fcbf049c185. Resources: {'key_pairs'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 16:03:32.982625 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-0e92c854-37b7-4d59-ab88-07577ccade0c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Getting quotas for user 34e42d4cebe14642a71209ddd2b25fd2 and project 202b681b581b4f6ea4fe9fcbf049c185. Resources: {'key_pairs'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 16:03:33.014557 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0e92c854-37b7-4d59-ab88-07577ccade0c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.340984 Jun 15 16:03:33.021009 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 547/1116] 10.222.0.62 () {60 vars in 1158 bytes} [Wed Jun 15 16:03:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:03:58.950811 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-240436945", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1844540297", "security_groups": [{"name": "tempest-secgroup-smoke-1866021784"}], "networks": [{"uuid": "bcc09e4a-c71b-4179-93a1-ba579f531577"}], "block_device_mapping_v2": [{"uuid": "40d594f3-3f63-4b0e-848b-3261ef176ede", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:03:58.959838 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=4 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:03:58.960485 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=8 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:03:59.061747 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.network.neutron [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] validate_networks() for [('bcc09e4a-c71b-4179-93a1-ba579f531577', None, None, None, None, None)] {{(pid=123934) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 16:03:59.419714 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Flavor limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 16:03:59.420080 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Image limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 16:03:59.420553 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Flavor pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 16:03:59.420959 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Image pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 16:03:59.421366 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 16:03:59.430720 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:03:59.431265 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:03:59.433066 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:03:59.433506 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:03:59.451163 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Getting quotas for project 202b681b581b4f6ea4fe9fcbf049c185. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 16:03:59.454812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Getting quotas for user 34e42d4cebe14642a71209ddd2b25fd2 and project 202b681b581b4f6ea4fe9fcbf049c185. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 16:03:59.511072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Going to run 1 instances... {{(pid=123934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 16:03:59.513100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40d594f3-3f63-4b0e-848b-3261ef176ede',volume_size=None,volume_type=None)] {{(pid=123934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 16:03:59.637176 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-6a9e22d3-2d21-4389-8ce6-66d2d36d683c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.690356 Jun 15 16:03:59.637808 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 570/1117] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 16:03:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 16:03:59.645855 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=4 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:03:59.646594 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:03:59.650958 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fff171cb-028b-41af-a7ab-b6f38a231b90 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:03:59.651748 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fff171cb-028b-41af-a7ab-b6f38a231b90 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:03:59.709945 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fff171cb-028b-41af-a7ab-b6f38a231b90 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:03:59.716807 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fff171cb-028b-41af-a7ab-b6f38a231b90 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1088 microversion: 2.1 time: 0.073053 Jun 15 16:03:59.717376 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 548/1118] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:03:59 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:00.734206 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-21278d75-9bd2-4b17-beb4-5aeb7217e15f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:00.734768 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-21278d75-9bd2-4b17-beb4-5aeb7217e15f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:00.741265 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21278d75-9bd2-4b17-beb4-5aeb7217e15f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:00.741696 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21278d75-9bd2-4b17-beb4-5aeb7217e15f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:00.742437 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21278d75-9bd2-4b17-beb4-5aeb7217e15f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:00.742920 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-21278d75-9bd2-4b17-beb4-5aeb7217e15f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:00.802097 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-21278d75-9bd2-4b17-beb4-5aeb7217e15f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:00.809266 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-21278d75-9bd2-4b17-beb4-5aeb7217e15f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1186 microversion: 2.1 time: 0.079534 Jun 15 16:04:00.809818 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 571/1119] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:00 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1186 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:04:01.827752 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-515e71ed-69bb-4195-9371-dc5d10cac22c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:01.828299 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-515e71ed-69bb-4195-9371-dc5d10cac22c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:01.836143 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-515e71ed-69bb-4195-9371-dc5d10cac22c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:01.836901 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-515e71ed-69bb-4195-9371-dc5d10cac22c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:01.837864 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-515e71ed-69bb-4195-9371-dc5d10cac22c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:01.838490 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-515e71ed-69bb-4195-9371-dc5d10cac22c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:01.990317 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-515e71ed-69bb-4195-9371-dc5d10cac22c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:02.000899 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-515e71ed-69bb-4195-9371-dc5d10cac22c tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1272 microversion: 2.1 time: 0.177460 Jun 15 16:04:02.001490 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 549/1120] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:01 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:02.394498 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-5c106117-25a4-4233-aba5-296808f3f1f2 req-304e6a1a-cdee-439d-9a5f-d7a7baa28bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9bf50a-8bee-42fe-a138-3c28a75f5f91", "tag": "7b567601-7c69-4f08-8731-9cf609b66c38"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:04:02.405849 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-5c106117-25a4-4233-aba5-296808f3f1f2 req-304e6a1a-cdee-439d-9a5f-d7a7baa28bc4 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:02.406458 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-5c106117-25a4-4233-aba5-296808f3f1f2 req-304e6a1a-cdee-439d-9a5f-d7a7baa28bc4 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:02.418443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-5c106117-25a4-4233-aba5-296808f3f1f2 req-304e6a1a-cdee-439d-9a5f-d7a7baa28bc4 service nova] Creating event network-changed:7b567601-7c69-4f08-8731-9cf609b66c38 for instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 on hv-cinder-84599 Jun 15 16:04:02.423502 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-5c106117-25a4-4233-aba5-296808f3f1f2 req-304e6a1a-cdee-439d-9a5f-d7a7baa28bc4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035924 Jun 15 16:04:02.424185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 572/1121] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:04:03.018777 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-eda3fc2c-618f-4881-9864-e5f2e79de913 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:03.019860 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-eda3fc2c-618f-4881-9864-e5f2e79de913 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:03.025763 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eda3fc2c-618f-4881-9864-e5f2e79de913 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:03.026210 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eda3fc2c-618f-4881-9864-e5f2e79de913 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:03.026986 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eda3fc2c-618f-4881-9864-e5f2e79de913 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:03.027414 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-eda3fc2c-618f-4881-9864-e5f2e79de913 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:03.155759 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-eda3fc2c-618f-4881-9864-e5f2e79de913 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:03.163775 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-eda3fc2c-618f-4881-9864-e5f2e79de913 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1260 microversion: 2.1 time: 0.149160 Jun 15 16:04:03.164339 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 550/1122] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:03 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:04.181810 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cf94ed13-5aef-4d87-b4c9-285355f065f1 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:04.182883 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-cf94ed13-5aef-4d87-b4c9-285355f065f1 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:04.191439 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf94ed13-5aef-4d87-b4c9-285355f065f1 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:04.191891 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf94ed13-5aef-4d87-b4c9-285355f065f1 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:04.192661 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf94ed13-5aef-4d87-b4c9-285355f065f1 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:04.193101 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cf94ed13-5aef-4d87-b4c9-285355f065f1 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:04.347245 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cf94ed13-5aef-4d87-b4c9-285355f065f1 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:04.354669 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-cf94ed13-5aef-4d87-b4c9-285355f065f1 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1260 microversion: 2.1 time: 0.177606 Jun 15 16:04:04.355261 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 573/1123] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:04 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:05.372095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-55ab6005-fa6d-4d96-a8e1-5dd6ee3731eb tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:05.372698 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-55ab6005-fa6d-4d96-a8e1-5dd6ee3731eb tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:05.379148 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55ab6005-fa6d-4d96-a8e1-5dd6ee3731eb tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:05.379595 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55ab6005-fa6d-4d96-a8e1-5dd6ee3731eb tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:05.380352 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55ab6005-fa6d-4d96-a8e1-5dd6ee3731eb tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:05.380783 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-55ab6005-fa6d-4d96-a8e1-5dd6ee3731eb tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:05.510589 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-55ab6005-fa6d-4d96-a8e1-5dd6ee3731eb tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:05.518012 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-55ab6005-fa6d-4d96-a8e1-5dd6ee3731eb tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1260 microversion: 2.1 time: 0.149854 Jun 15 16:04:05.518578 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 551/1124] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:05 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:06.535482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-984d2522-f986-422e-851a-1428baac83b4 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:06.536118 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-984d2522-f986-422e-851a-1428baac83b4 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:06.542796 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-984d2522-f986-422e-851a-1428baac83b4 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:06.543241 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-984d2522-f986-422e-851a-1428baac83b4 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:06.544013 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-984d2522-f986-422e-851a-1428baac83b4 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:06.544423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-984d2522-f986-422e-851a-1428baac83b4 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:06.675749 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-984d2522-f986-422e-851a-1428baac83b4 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:06.683090 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-984d2522-f986-422e-851a-1428baac83b4 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1260 microversion: 2.1 time: 0.152072 Jun 15 16:04:06.684185 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 574/1125] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:06 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:07.701052 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-75f56e17-9ade-48b7-a176-15d35425753a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:07.701888 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-75f56e17-9ade-48b7-a176-15d35425753a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:07.709095 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-75f56e17-9ade-48b7-a176-15d35425753a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:07.709916 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-75f56e17-9ade-48b7-a176-15d35425753a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:07.711354 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-75f56e17-9ade-48b7-a176-15d35425753a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:07.712127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-75f56e17-9ade-48b7-a176-15d35425753a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:07.846615 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-75f56e17-9ade-48b7-a176-15d35425753a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:07.854590 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-75f56e17-9ade-48b7-a176-15d35425753a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1260 microversion: 2.1 time: 0.157955 Jun 15 16:04:07.855187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 552/1126] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:07 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:08.871369 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a09dc2c4-d0f7-471b-8375-4c11a74f8b54 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:08.872060 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a09dc2c4-d0f7-471b-8375-4c11a74f8b54 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:08.878545 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a09dc2c4-d0f7-471b-8375-4c11a74f8b54 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:08.879015 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a09dc2c4-d0f7-471b-8375-4c11a74f8b54 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:08.879800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a09dc2c4-d0f7-471b-8375-4c11a74f8b54 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:08.880862 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a09dc2c4-d0f7-471b-8375-4c11a74f8b54 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:09.009022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a09dc2c4-d0f7-471b-8375-4c11a74f8b54 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:09.016396 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a09dc2c4-d0f7-471b-8375-4c11a74f8b54 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1260 microversion: 2.1 time: 0.148906 Jun 15 16:04:09.016952 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 575/1127] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:08 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:10.032662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3b167975-9c36-4129-9690-034cf4cc232a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:10.033207 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3b167975-9c36-4129-9690-034cf4cc232a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:10.035582 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:04:10.041699 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b167975-9c36-4129-9690-034cf4cc232a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:10.042146 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b167975-9c36-4129-9690-034cf4cc232a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:10.042936 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b167975-9c36-4129-9690-034cf4cc232a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:10.043371 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b167975-9c36-4129-9690-034cf4cc232a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:10.173176 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3b167975-9c36-4129-9690-034cf4cc232a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:10.181145 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3b167975-9c36-4129-9690-034cf4cc232a tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1260 microversion: 2.1 time: 0.152474 Jun 15 16:04:10.181709 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 553/1128] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:10 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:11.197298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2930dad5-4134-4702-bc41-29d361cc4a1d tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:11.197896 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2930dad5-4134-4702-bc41-29d361cc4a1d tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:11.199964 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:04:11.200616 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=6 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:04:11.207222 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2930dad5-4134-4702-bc41-29d361cc4a1d tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:11.207660 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2930dad5-4134-4702-bc41-29d361cc4a1d tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:11.208917 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2930dad5-4134-4702-bc41-29d361cc4a1d tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:11.209338 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2930dad5-4134-4702-bc41-29d361cc4a1d tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:11.343632 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2930dad5-4134-4702-bc41-29d361cc4a1d tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:11.352227 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2930dad5-4134-4702-bc41-29d361cc4a1d tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1260 microversion: 2.1 time: 0.158708 Jun 15 16:04:11.352795 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 576/1129] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:11 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:12.369184 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e8850ceb-6d38-40f9-913b-7f5fa617cb06 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:12.369804 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e8850ceb-6d38-40f9-913b-7f5fa617cb06 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:12.376116 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e8850ceb-6d38-40f9-913b-7f5fa617cb06 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:12.376563 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e8850ceb-6d38-40f9-913b-7f5fa617cb06 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:12.377329 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e8850ceb-6d38-40f9-913b-7f5fa617cb06 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:12.377765 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e8850ceb-6d38-40f9-913b-7f5fa617cb06 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:12.517643 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e8850ceb-6d38-40f9-913b-7f5fa617cb06 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:12.525720 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e8850ceb-6d38-40f9-913b-7f5fa617cb06 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1260 microversion: 2.1 time: 0.160510 Jun 15 16:04:12.526295 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 554/1130] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:12 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:13.543193 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ffe615eb-1e03-46f5-b1ee-e533e571c426 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:13.543738 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ffe615eb-1e03-46f5-b1ee-e533e571c426 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:13.550952 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ffe615eb-1e03-46f5-b1ee-e533e571c426 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:13.551407 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ffe615eb-1e03-46f5-b1ee-e533e571c426 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:13.552166 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ffe615eb-1e03-46f5-b1ee-e533e571c426 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:13.552605 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ffe615eb-1e03-46f5-b1ee-e533e571c426 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:13.664080 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-58c2b8ed-6b35-4771-ba91-f4bd923083d8 req-dabcade7-cd4f-4bb6-910c-7058771033a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9bf50a-8bee-42fe-a138-3c28a75f5f91", "name": "network-vif-plugged", "status": "completed", "tag": "7b567601-7c69-4f08-8731-9cf609b66c38"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:04:13.672863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-58c2b8ed-6b35-4771-ba91-f4bd923083d8 req-dabcade7-cd4f-4bb6-910c-7058771033a6 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:13.673571 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-58c2b8ed-6b35-4771-ba91-f4bd923083d8 req-dabcade7-cd4f-4bb6-910c-7058771033a6 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:13.684633 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ffe615eb-1e03-46f5-b1ee-e533e571c426 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:13.693030 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ffe615eb-1e03-46f5-b1ee-e533e571c426 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1260 microversion: 2.1 time: 0.153465 Jun 15 16:04:13.693258 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-58c2b8ed-6b35-4771-ba91-f4bd923083d8 req-dabcade7-cd4f-4bb6-910c-7058771033a6 service nova] Creating event network-vif-plugged:7b567601-7c69-4f08-8731-9cf609b66c38 for instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 on hv-cinder-84599 Jun 15 16:04:13.704382 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 577/1131] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:13 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:13.705773 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-58c2b8ed-6b35-4771-ba91-f4bd923083d8 req-dabcade7-cd4f-4bb6-910c-7058771033a6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047240 Jun 15 16:04:13.706697 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 555/1132] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 16:04:14.710585 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cae68391-2b7d-43dd-9fc7-6b3e71176aa9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:14.711251 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-cae68391-2b7d-43dd-9fc7-6b3e71176aa9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:14.717499 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cae68391-2b7d-43dd-9fc7-6b3e71176aa9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:14.718029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cae68391-2b7d-43dd-9fc7-6b3e71176aa9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:14.718813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cae68391-2b7d-43dd-9fc7-6b3e71176aa9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:14.719242 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cae68391-2b7d-43dd-9fc7-6b3e71176aa9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:14.852722 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cae68391-2b7d-43dd-9fc7-6b3e71176aa9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:14.860279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-cae68391-2b7d-43dd-9fc7-6b3e71176aa9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1260 microversion: 2.1 time: 0.153565 Jun 15 16:04:14.860840 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 578/1133] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:14 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:15.877835 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8f45b539-3304-41f9-8ef1-89cf1f3bd8f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:15.878537 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-8f45b539-3304-41f9-8ef1-89cf1f3bd8f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:15.885468 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8f45b539-3304-41f9-8ef1-89cf1f3bd8f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:15.885920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8f45b539-3304-41f9-8ef1-89cf1f3bd8f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:15.886687 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8f45b539-3304-41f9-8ef1-89cf1f3bd8f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:15.887153 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8f45b539-3304-41f9-8ef1-89cf1f3bd8f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:16.022782 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-8f45b539-3304-41f9-8ef1-89cf1f3bd8f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:16.030277 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-8f45b539-3304-41f9-8ef1-89cf1f3bd8f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1444 microversion: 2.1 time: 0.157114 Jun 15 16:04:16.030902 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 556/1134] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:15 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:16.046629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c64a602c-4401-4b63-b451-a92bd263c5da tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:16.047284 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c64a602c-4401-4b63-b451-a92bd263c5da tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:16.054195 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c64a602c-4401-4b63-b451-a92bd263c5da tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:16.054633 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c64a602c-4401-4b63-b451-a92bd263c5da tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:16.055398 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c64a602c-4401-4b63-b451-a92bd263c5da tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:16.055823 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c64a602c-4401-4b63-b451-a92bd263c5da tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:16.184163 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c64a602c-4401-4b63-b451-a92bd263c5da tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:16.191627 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c64a602c-4401-4b63-b451-a92bd263c5da tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1444 microversion: 2.1 time: 0.148753 Jun 15 16:04:16.192183 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 579/1135] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:16 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:18.136981 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-49239088-faf8-455e-b97b-1f43c8d41dc7 req-6468a5c2-3cef-45cf-9c29-a3c8e2aaf01f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9bf50a-8bee-42fe-a138-3c28a75f5f91", "tag": "7b567601-7c69-4f08-8731-9cf609b66c38"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:04:18.145408 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-49239088-faf8-455e-b97b-1f43c8d41dc7 req-6468a5c2-3cef-45cf-9c29-a3c8e2aaf01f service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:18.146359 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-49239088-faf8-455e-b97b-1f43c8d41dc7 req-6468a5c2-3cef-45cf-9c29-a3c8e2aaf01f service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:18.157078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-49239088-faf8-455e-b97b-1f43c8d41dc7 req-6468a5c2-3cef-45cf-9c29-a3c8e2aaf01f service nova] Creating event network-changed:7b567601-7c69-4f08-8731-9cf609b66c38 for instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 on hv-cinder-84599 Jun 15 16:04:18.162838 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-49239088-faf8-455e-b97b-1f43c8d41dc7 req-6468a5c2-3cef-45cf-9c29-a3c8e2aaf01f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029571 Jun 15 16:04:18.163427 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 557/1136] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:04:29.244781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-e6cd1059-4054-46ab-8cac-2f84deecd6c3 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:04:29.245748 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-e6cd1059-4054-46ab-8cac-2f84deecd6c3 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:29.248201 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:04:29.248841 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=52 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:04:29.254611 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e6cd1059-4054-46ab-8cac-2f84deecd6c3 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:29.255079 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e6cd1059-4054-46ab-8cac-2f84deecd6c3 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:29.255821 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e6cd1059-4054-46ab-8cac-2f84deecd6c3 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:29.256754 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-e6cd1059-4054-46ab-8cac-2f84deecd6c3 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:29.330118 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-e6cd1059-4054-46ab-8cac-2f84deecd6c3 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "POST /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/action" status: 202 len: 0 microversion: 2.1 time: 0.089038 Jun 15 16:04:29.330952 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 580/1137] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 16:04:29 2022] POST /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:04:29.337394 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=22 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:04:29.338163 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=46 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:04:29.342679 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c4992549-6142-4098-8462-785857f189c8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:29.343437 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c4992549-6142-4098-8462-785857f189c8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:29.351487 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c4992549-6142-4098-8462-785857f189c8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:29.351979 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c4992549-6142-4098-8462-785857f189c8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:29.353090 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c4992549-6142-4098-8462-785857f189c8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:29.353448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c4992549-6142-4098-8462-785857f189c8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:29.500101 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c4992549-6142-4098-8462-785857f189c8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:29.508687 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c4992549-6142-4098-8462-785857f189c8 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1748 microversion: 2.1 time: 0.172736 Jun 15 16:04:29.509265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 558/1138] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:29 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:30.526169 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d4500c3b-4f2d-4a98-8f9a-af76aa9f63e9 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:30.526831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d4500c3b-4f2d-4a98-8f9a-af76aa9f63e9 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:30.533143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4500c3b-4f2d-4a98-8f9a-af76aa9f63e9 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:30.533617 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4500c3b-4f2d-4a98-8f9a-af76aa9f63e9 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:30.534378 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4500c3b-4f2d-4a98-8f9a-af76aa9f63e9 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:30.534865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d4500c3b-4f2d-4a98-8f9a-af76aa9f63e9 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:30.681871 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-d4500c3b-4f2d-4a98-8f9a-af76aa9f63e9 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:30.689824 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d4500c3b-4f2d-4a98-8f9a-af76aa9f63e9 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.168180 Jun 15 16:04:30.690382 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 581/1139] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:30 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:31.707285 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3b3af9ba-7423-43c5-8399-bba7c80a0b7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:31.707823 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3b3af9ba-7423-43c5-8399-bba7c80a0b7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:31.714347 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b3af9ba-7423-43c5-8399-bba7c80a0b7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:31.714827 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b3af9ba-7423-43c5-8399-bba7c80a0b7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:31.715615 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b3af9ba-7423-43c5-8399-bba7c80a0b7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:31.716047 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3b3af9ba-7423-43c5-8399-bba7c80a0b7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:31.858722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3b3af9ba-7423-43c5-8399-bba7c80a0b7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:31.867221 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3b3af9ba-7423-43c5-8399-bba7c80a0b7c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.163871 Jun 15 16:04:31.867782 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 559/1140] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:31 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:32.883908 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5f5474a2-9741-4dfc-8015-fc8e82e4902a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:32.884525 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5f5474a2-9741-4dfc-8015-fc8e82e4902a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:32.890991 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5f5474a2-9741-4dfc-8015-fc8e82e4902a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:32.891440 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5f5474a2-9741-4dfc-8015-fc8e82e4902a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:32.892191 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5f5474a2-9741-4dfc-8015-fc8e82e4902a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:32.892623 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5f5474a2-9741-4dfc-8015-fc8e82e4902a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:33.030635 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5f5474a2-9741-4dfc-8015-fc8e82e4902a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:33.039023 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5f5474a2-9741-4dfc-8015-fc8e82e4902a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.158977 Jun 15 16:04:33.039586 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 582/1141] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:32 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:34.056865 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7e01f62a-0b69-4fc3-93cc-6efff0b61b84 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:34.057427 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7e01f62a-0b69-4fc3-93cc-6efff0b61b84 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:34.063487 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e01f62a-0b69-4fc3-93cc-6efff0b61b84 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:34.063938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e01f62a-0b69-4fc3-93cc-6efff0b61b84 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:34.064696 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e01f62a-0b69-4fc3-93cc-6efff0b61b84 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:34.065129 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7e01f62a-0b69-4fc3-93cc-6efff0b61b84 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:34.203414 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7e01f62a-0b69-4fc3-93cc-6efff0b61b84 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:34.211312 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7e01f62a-0b69-4fc3-93cc-6efff0b61b84 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.159160 Jun 15 16:04:34.211874 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 560/1142] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:34 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:35.232573 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-0c9cc773-1020-47f7-b41d-f7777d2894e5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:35.233412 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-0c9cc773-1020-47f7-b41d-f7777d2894e5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:35.241860 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c9cc773-1020-47f7-b41d-f7777d2894e5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:35.242360 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c9cc773-1020-47f7-b41d-f7777d2894e5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:35.243136 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c9cc773-1020-47f7-b41d-f7777d2894e5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:35.243567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-0c9cc773-1020-47f7-b41d-f7777d2894e5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:35.386637 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-0c9cc773-1020-47f7-b41d-f7777d2894e5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:35.394565 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-0c9cc773-1020-47f7-b41d-f7777d2894e5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.170302 Jun 15 16:04:35.395156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 583/1143] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:35 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:36.414652 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2725d602-b921-44cc-850c-aee3f6723ab2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:36.415280 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2725d602-b921-44cc-850c-aee3f6723ab2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:36.421955 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2725d602-b921-44cc-850c-aee3f6723ab2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:36.422397 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2725d602-b921-44cc-850c-aee3f6723ab2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:36.423172 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2725d602-b921-44cc-850c-aee3f6723ab2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:36.423601 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2725d602-b921-44cc-850c-aee3f6723ab2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:36.562441 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2725d602-b921-44cc-850c-aee3f6723ab2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:36.570769 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2725d602-b921-44cc-850c-aee3f6723ab2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.160600 Jun 15 16:04:36.571333 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 561/1144] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:36 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:37.587636 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-721584fc-8d41-4ddf-a848-5bafa6fc2961 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:37.588250 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-721584fc-8d41-4ddf-a848-5bafa6fc2961 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:37.594646 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-721584fc-8d41-4ddf-a848-5bafa6fc2961 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:37.595139 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-721584fc-8d41-4ddf-a848-5bafa6fc2961 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:37.595872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-721584fc-8d41-4ddf-a848-5bafa6fc2961 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:37.596300 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-721584fc-8d41-4ddf-a848-5bafa6fc2961 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:37.734560 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-721584fc-8d41-4ddf-a848-5bafa6fc2961 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:37.742472 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-721584fc-8d41-4ddf-a848-5bafa6fc2961 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.158768 Jun 15 16:04:37.743069 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 584/1145] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:37 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:38.759398 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b77d6647-6708-4ec1-bd5a-7fc530b3ada2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:38.759934 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b77d6647-6708-4ec1-bd5a-7fc530b3ada2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:38.766424 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b77d6647-6708-4ec1-bd5a-7fc530b3ada2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:38.766909 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b77d6647-6708-4ec1-bd5a-7fc530b3ada2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:38.767675 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b77d6647-6708-4ec1-bd5a-7fc530b3ada2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:38.768111 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b77d6647-6708-4ec1-bd5a-7fc530b3ada2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:38.916330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b77d6647-6708-4ec1-bd5a-7fc530b3ada2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:38.924604 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b77d6647-6708-4ec1-bd5a-7fc530b3ada2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.169236 Jun 15 16:04:38.925166 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 562/1146] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:38 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:39.941444 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a349d18a-ead1-4f53-a8f2-83e5df20453c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:39.942082 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a349d18a-ead1-4f53-a8f2-83e5df20453c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:39.948590 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a349d18a-ead1-4f53-a8f2-83e5df20453c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:39.949029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a349d18a-ead1-4f53-a8f2-83e5df20453c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:39.949773 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a349d18a-ead1-4f53-a8f2-83e5df20453c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:39.950199 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a349d18a-ead1-4f53-a8f2-83e5df20453c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:40.088972 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a349d18a-ead1-4f53-a8f2-83e5df20453c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:40.096732 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a349d18a-ead1-4f53-a8f2-83e5df20453c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.159188 Jun 15 16:04:40.097288 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 585/1147] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:39 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:41.113943 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7b9b5c4a-05f1-4984-9666-a2d5a0301bf2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:41.114527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7b9b5c4a-05f1-4984-9666-a2d5a0301bf2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:41.121838 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7b9b5c4a-05f1-4984-9666-a2d5a0301bf2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:41.122276 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7b9b5c4a-05f1-4984-9666-a2d5a0301bf2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:41.123093 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7b9b5c4a-05f1-4984-9666-a2d5a0301bf2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:41.123522 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7b9b5c4a-05f1-4984-9666-a2d5a0301bf2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:41.266598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7b9b5c4a-05f1-4984-9666-a2d5a0301bf2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:41.274517 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7b9b5c4a-05f1-4984-9666-a2d5a0301bf2 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.164442 Jun 15 16:04:41.275114 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 563/1148] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:41 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:42.291477 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1c3447f1-68a4-49e6-bf5a-3160fe90cb9b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:42.292354 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1c3447f1-68a4-49e6-bf5a-3160fe90cb9b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:42.298878 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1c3447f1-68a4-49e6-bf5a-3160fe90cb9b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:42.299325 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1c3447f1-68a4-49e6-bf5a-3160fe90cb9b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:42.300073 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1c3447f1-68a4-49e6-bf5a-3160fe90cb9b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:42.300503 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1c3447f1-68a4-49e6-bf5a-3160fe90cb9b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:42.440575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1c3447f1-68a4-49e6-bf5a-3160fe90cb9b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:42.449309 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1c3447f1-68a4-49e6-bf5a-3160fe90cb9b tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.161712 Jun 15 16:04:42.449874 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 586/1149] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:42 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:43.466271 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2958fdfe-f3f6-4202-a59d-43fe9d8b4386 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:43.466922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2958fdfe-f3f6-4202-a59d-43fe9d8b4386 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:43.473452 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2958fdfe-f3f6-4202-a59d-43fe9d8b4386 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:43.473911 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2958fdfe-f3f6-4202-a59d-43fe9d8b4386 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:43.474672 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2958fdfe-f3f6-4202-a59d-43fe9d8b4386 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:43.475135 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2958fdfe-f3f6-4202-a59d-43fe9d8b4386 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:43.620701 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2958fdfe-f3f6-4202-a59d-43fe9d8b4386 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:43.629215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2958fdfe-f3f6-4202-a59d-43fe9d8b4386 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.166953 Jun 15 16:04:43.629783 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 564/1150] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:43 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:44.645303 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1d671792-2a21-45b0-8bc2-f2a843f25c92 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:44.645938 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1d671792-2a21-45b0-8bc2-f2a843f25c92 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:44.653059 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d671792-2a21-45b0-8bc2-f2a843f25c92 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:44.653500 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d671792-2a21-45b0-8bc2-f2a843f25c92 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:44.654250 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d671792-2a21-45b0-8bc2-f2a843f25c92 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:44.654676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1d671792-2a21-45b0-8bc2-f2a843f25c92 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:44.791155 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1d671792-2a21-45b0-8bc2-f2a843f25c92 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:44.799345 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1d671792-2a21-45b0-8bc2-f2a843f25c92 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.157897 Jun 15 16:04:44.799903 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 587/1151] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:44 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:45.816388 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-3f17b6ec-de42-42f1-98af-2a37d492d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:45.816928 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-3f17b6ec-de42-42f1-98af-2a37d492d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:45.823419 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f17b6ec-de42-42f1-98af-2a37d492d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:45.823866 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f17b6ec-de42-42f1-98af-2a37d492d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:45.824624 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f17b6ec-de42-42f1-98af-2a37d492d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:45.825055 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-3f17b6ec-de42-42f1-98af-2a37d492d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:45.965113 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-3f17b6ec-de42-42f1-98af-2a37d492d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:45.973438 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-3f17b6ec-de42-42f1-98af-2a37d492d362 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1753 microversion: 2.1 time: 0.160960 Jun 15 16:04:45.974106 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 565/1152] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:45 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:04:46.990970 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-acf3953c-4675-4c88-abda-8002ce0e9fed tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:04:46.991559 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-acf3953c-4675-4c88-abda-8002ce0e9fed tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:04:46.998540 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-acf3953c-4675-4c88-abda-8002ce0e9fed tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:46.999021 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-acf3953c-4675-4c88-abda-8002ce0e9fed tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:46.999776 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-acf3953c-4675-4c88-abda-8002ce0e9fed tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:04:47.000208 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-acf3953c-4675-4c88-abda-8002ce0e9fed tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:04:47.141812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-acf3953c-4675-4c88-abda-8002ce0e9fed tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:04:47.150421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-acf3953c-4675-4c88-abda-8002ce0e9fed tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1756 microversion: 2.1 time: 0.163353 Jun 15 16:04:47.151020 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 588/1153] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:04:46 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:04.005408 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:05:04.006023 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 16:05:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:05:06.004224 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:05:06.004833 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Wed Jun 15 16:05:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:05:23.155243 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6f47b247-50ca-48cc-a38a-561cfbbfc96e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:23.155929 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6f47b247-50ca-48cc-a38a-561cfbbfc96e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:23.157737 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=16 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:05:23.158383 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=48 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:05:23.164607 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6f47b247-50ca-48cc-a38a-561cfbbfc96e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:23.165059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6f47b247-50ca-48cc-a38a-561cfbbfc96e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:23.165830 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6f47b247-50ca-48cc-a38a-561cfbbfc96e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:23.166269 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6f47b247-50ca-48cc-a38a-561cfbbfc96e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:23.191497 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6f47b247-50ca-48cc-a38a-561cfbbfc96e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Going to try to terminate instance {{(pid=123935) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 16:05:23.266158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6f47b247-50ca-48cc-a38a-561cfbbfc96e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 204 len: 0 microversion: 2.1 time: 0.114749 Jun 15 16:05:23.267121 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 566/1154] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:05:23 2022] DELETE /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 16:05:23.276981 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-08a689d9-a173-4618-a44a-ebb1ad6cc38f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:23.277589 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-08a689d9-a173-4618-a44a-ebb1ad6cc38f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:23.279606 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=18 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:05:23.280262 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:05:23.285878 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-08a689d9-a173-4618-a44a-ebb1ad6cc38f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:23.286312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-08a689d9-a173-4618-a44a-ebb1ad6cc38f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:23.287102 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-08a689d9-a173-4618-a44a-ebb1ad6cc38f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:23.287530 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-08a689d9-a173-4618-a44a-ebb1ad6cc38f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:23.553329 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-08a689d9-a173-4618-a44a-ebb1ad6cc38f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:23.561209 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-08a689d9-a173-4618-a44a-ebb1ad6cc38f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1574 microversion: 2.1 time: 0.290023 Jun 15 16:05:23.561759 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 589/1155] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:23 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1574 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:24.581165 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c84408f7-443a-4c69-a0d1-015ec89dde53 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:24.581796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c84408f7-443a-4c69-a0d1-015ec89dde53 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:24.589109 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c84408f7-443a-4c69-a0d1-015ec89dde53 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:24.589536 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c84408f7-443a-4c69-a0d1-015ec89dde53 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:24.590288 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c84408f7-443a-4c69-a0d1-015ec89dde53 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:24.590717 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c84408f7-443a-4c69-a0d1-015ec89dde53 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:24.774616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c84408f7-443a-4c69-a0d1-015ec89dde53 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:24.782179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c84408f7-443a-4c69-a0d1-015ec89dde53 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1574 microversion: 2.1 time: 0.205359 Jun 15 16:05:24.782747 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 567/1156] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:24 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:25.799421 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-135a18c3-cac9-4292-b947-a79814f0a491 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:25.799946 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-135a18c3-cac9-4292-b947-a79814f0a491 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:25.806723 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-135a18c3-cac9-4292-b947-a79814f0a491 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:25.807192 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-135a18c3-cac9-4292-b947-a79814f0a491 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:25.807944 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-135a18c3-cac9-4292-b947-a79814f0a491 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:25.808369 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-135a18c3-cac9-4292-b947-a79814f0a491 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:25.940638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-135a18c3-cac9-4292-b947-a79814f0a491 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:25.950100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-135a18c3-cac9-4292-b947-a79814f0a491 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1574 microversion: 2.1 time: 0.154488 Jun 15 16:05:25.950919 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 590/1157] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:25 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:26.210294 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-d79ef5ed-62ae-4f21-93fc-eb8c98c955d7 req-d02046c5-22e0-47e8-915d-34ec52e71789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e337762-1c2f-446b-b266-8a491f6f3a94", "name": "network-vif-deleted", "tag": "d34c8693-5e99-46b1-adfb-f3f6cf283ae7"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:05:26.221905 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-d79ef5ed-62ae-4f21-93fc-eb8c98c955d7 req-d02046c5-22e0-47e8-915d-34ec52e71789 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:26.222443 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-d79ef5ed-62ae-4f21-93fc-eb8c98c955d7 req-d02046c5-22e0-47e8-915d-34ec52e71789 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:26.235915 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-d79ef5ed-62ae-4f21-93fc-eb8c98c955d7 req-d02046c5-22e0-47e8-915d-34ec52e71789 service nova] Creating event network-vif-deleted:d34c8693-5e99-46b1-adfb-f3f6cf283ae7 for instance 6e337762-1c2f-446b-b266-8a491f6f3a94 on hv-cinder-84599 Jun 15 16:05:26.242399 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-d79ef5ed-62ae-4f21-93fc-eb8c98c955d7 req-d02046c5-22e0-47e8-915d-34ec52e71789 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035345 Jun 15 16:05:26.243941 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 568/1158] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:05:26.967443 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1735a28c-e9f3-49da-b0c0-9197f41ed3e9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:26.968148 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1735a28c-e9f3-49da-b0c0-9197f41ed3e9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:26.974998 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1735a28c-e9f3-49da-b0c0-9197f41ed3e9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:26.975802 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1735a28c-e9f3-49da-b0c0-9197f41ed3e9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:26.977136 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1735a28c-e9f3-49da-b0c0-9197f41ed3e9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:26.977688 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1735a28c-e9f3-49da-b0c0-9197f41ed3e9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:27.013135 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1735a28c-e9f3-49da-b0c0-9197f41ed3e9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:27.013606 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1735a28c-e9f3-49da-b0c0-9197f41ed3e9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:27.014055 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-1735a28c-e9f3-49da-b0c0-9197f41ed3e9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lazy-loading 'fault' on Instance uuid 6e337762-1c2f-446b-b266-8a491f6f3a94 {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:05:27.057936 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1735a28c-e9f3-49da-b0c0-9197f41ed3e9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:27.067480 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1735a28c-e9f3-49da-b0c0-9197f41ed3e9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 200 len: 1230 microversion: 2.1 time: 0.103792 Jun 15 16:05:27.068156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 591/1159] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:26 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:28.085461 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f83a039e-899f-4f54-b58f-cb28b7fee0c4 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:28.086185 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f83a039e-899f-4f54-b58f-cb28b7fee0c4 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:28.092861 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f83a039e-899f-4f54-b58f-cb28b7fee0c4 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:28.093302 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f83a039e-899f-4f54-b58f-cb28b7fee0c4 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:28.094052 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f83a039e-899f-4f54-b58f-cb28b7fee0c4 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:28.094478 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f83a039e-899f-4f54-b58f-cb28b7fee0c4 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:28.107492 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-f83a039e-899f-4f54-b58f-cb28b7fee0c4 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] HTTP exception thrown: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f83a039e-899f-4f54-b58f-cb28b7fee0c4 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Request method failure captured: Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 HTTP/1.1 Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgJNDY0-ArjL_k1voyQ1R0pPU12yHKBq2oXaHVTTBGeM6ikjfq1mIiOt6pa3PVxmXSacUXhkA3HWhRI2JGZXHmIetpgGKiHbvNal3rceaDJ-lwU4d0_mMkwMwD3e-YVgNtvKIs2caqyx3kDeS8GpEnzP8jnOxUAIa_pWBOULoR8cH0o Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 31480d73f44447679761a5acac79dc02 Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:05:28.109078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31480d73f44447679761a5acac79dc02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31480d73f44447679761a5acac79dc02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31480d73f44447679761a5acac79dc02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31480d73f44447679761a5acac79dc02", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 31480d73f44447679761a5acac79dc02 Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-TestVolumeBootPattern-1112771182-project Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: f18270589e8745a286e3c78a7f86b25d Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-TestVolumeBootPattern-1112771182-project Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:05:28.110796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': '6e337762-1c2f-446b-b266-8a491f6f3a94'} Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:05:28.111793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:05:28.113560 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:05:28.115043 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f83a039e-899f-4f54-b58f-cb28b7fee0c4 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Returning 404 to user: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:05:28.115043 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f83a039e-899f-4f54-b58f-cb28b7fee0c4 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 404 len: 111 microversion: 2.1 time: 0.029152 Jun 15 16:05:28.115043 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 569/1160] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:28 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:05:28.204289 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1802630714", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2141088859", "security_groups": [{"name": "tempest-secgroup-smoke-662739945"}], "block_device_mapping_v2": [{"uuid": "29e1d6da-0d85-4c8c-ad32-6eac6aeb96e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b3187a5-ab83-4eae-958d-943b33483207"}]}} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:05:28.313497 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.network.neutron [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] validate_networks() for [('9b3187a5-ab83-4eae-958d-943b33483207', None, None, None, None, None)] {{(pid=123934) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 16:05:28.673784 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Flavor limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 16:05:28.674198 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Image limits 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 16:05:28.674661 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Flavor pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 16:05:28.675091 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Image pref 0:0:0 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 16:05:28.675488 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.virt.hardware [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 16:05:28.684140 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:28.684575 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:28.685352 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:28.685772 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:28.701800 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Getting quotas for project 31480d73f44447679761a5acac79dc02. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 16:05:28.705667 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.quota [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Getting quotas for user f18270589e8745a286e3c78a7f86b25d and project 31480d73f44447679761a5acac79dc02. Resources: {'instances', 'cores', 'ram'} {{(pid=123934) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 16:05:28.760846 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Going to run 1 instances... {{(pid=123934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 16:05:28.762910 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29e1d6da-0d85-4c8c-ad32-6eac6aeb96e2',volume_size=None,volume_type=None)] {{(pid=123934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 16:05:28.888649 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-98d952d1-d289-43ee-949c-3efa2f9631f2 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.688175 Jun 15 16:05:28.889286 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 592/1161] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 16:05:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 16:05:28.899836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a8bfa9bb-9d22-433b-bc12-a42d9859e312 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:28.900452 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a8bfa9bb-9d22-433b-bc12-a42d9859e312 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:28.957449 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a8bfa9bb-9d22-433b-bc12-a42d9859e312 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:28.964905 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a8bfa9bb-9d22-433b-bc12-a42d9859e312 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1095 microversion: 2.1 time: 0.069519 Jun 15 16:05:28.965467 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 570/1162] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:28 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:29.982003 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-8d02faa9-8ba9-4f11-851d-676b775788f7 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:29.982621 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-8d02faa9-8ba9-4f11-851d-676b775788f7 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:29.989277 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8d02faa9-8ba9-4f11-851d-676b775788f7 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:29.989725 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8d02faa9-8ba9-4f11-851d-676b775788f7 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:29.990489 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8d02faa9-8ba9-4f11-851d-676b775788f7 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:29.990951 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-8d02faa9-8ba9-4f11-851d-676b775788f7 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:30.061297 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-8d02faa9-8ba9-4f11-851d-676b775788f7 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:30.071279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-8d02faa9-8ba9-4f11-851d-676b775788f7 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1211 microversion: 2.1 time: 0.093100 Jun 15 16:05:30.072994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 593/1163] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:29 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:31.089840 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-dbe2c522-9602-4f89-ad1d-be9926ffa76f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:31.091314 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-dbe2c522-9602-4f89-ad1d-be9926ffa76f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:31.099086 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbe2c522-9602-4f89-ad1d-be9926ffa76f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:31.099539 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbe2c522-9602-4f89-ad1d-be9926ffa76f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:31.100307 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbe2c522-9602-4f89-ad1d-be9926ffa76f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:31.100734 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-dbe2c522-9602-4f89-ad1d-be9926ffa76f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:31.241604 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-dbe2c522-9602-4f89-ad1d-be9926ffa76f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:31.250764 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-2a22e3f3-ec55-4b59-b98d-7a96e95c18a0 req-72e943f2-3830-4811-857c-b0925efc3ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35839905-12f5-44c8-aa9d-8c0736d9a25f", "tag": "360cf5f3-f5f2-4177-8fb6-d338cab9226e"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:05:31.261173 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-dbe2c522-9602-4f89-ad1d-be9926ffa76f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1266 microversion: 2.1 time: 0.175462 Jun 15 16:05:31.261766 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 571/1164] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:31 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:31.265864 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-2a22e3f3-ec55-4b59-b98d-7a96e95c18a0 req-72e943f2-3830-4811-857c-b0925efc3ad6 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:31.266547 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-2a22e3f3-ec55-4b59-b98d-7a96e95c18a0 req-72e943f2-3830-4811-857c-b0925efc3ad6 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:31.279072 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-2a22e3f3-ec55-4b59-b98d-7a96e95c18a0 req-72e943f2-3830-4811-857c-b0925efc3ad6 service nova] Creating event network-changed:360cf5f3-f5f2-4177-8fb6-d338cab9226e for instance 35839905-12f5-44c8-aa9d-8c0736d9a25f on hv-cinder-84599 Jun 15 16:05:31.286950 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-2a22e3f3-ec55-4b59-b98d-7a96e95c18a0 req-72e943f2-3830-4811-857c-b0925efc3ad6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039755 Jun 15 16:05:31.287631 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 594/1165] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:05:32.278067 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-92e77fe0-44cb-4b63-8034-91705c9ee2b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:32.278669 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-92e77fe0-44cb-4b63-8034-91705c9ee2b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:32.285172 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-92e77fe0-44cb-4b63-8034-91705c9ee2b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:32.285616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-92e77fe0-44cb-4b63-8034-91705c9ee2b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:32.286359 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-92e77fe0-44cb-4b63-8034-91705c9ee2b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:32.286813 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-92e77fe0-44cb-4b63-8034-91705c9ee2b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:32.422912 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-92e77fe0-44cb-4b63-8034-91705c9ee2b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:32.431117 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-92e77fe0-44cb-4b63-8034-91705c9ee2b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1266 microversion: 2.1 time: 0.157633 Jun 15 16:05:32.431688 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 572/1166] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:32 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:33.449461 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-76defb74-2597-40ae-accb-ff3ee9b8c8fe tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:33.450273 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-76defb74-2597-40ae-accb-ff3ee9b8c8fe tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:33.456550 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-76defb74-2597-40ae-accb-ff3ee9b8c8fe tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:33.456994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-76defb74-2597-40ae-accb-ff3ee9b8c8fe tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:33.457751 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-76defb74-2597-40ae-accb-ff3ee9b8c8fe tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:33.458182 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-76defb74-2597-40ae-accb-ff3ee9b8c8fe tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:33.586753 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-76defb74-2597-40ae-accb-ff3ee9b8c8fe tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:33.594090 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-76defb74-2597-40ae-accb-ff3ee9b8c8fe tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1266 microversion: 2.1 time: 0.149989 Jun 15 16:05:33.594640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 595/1167] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:33 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:34.611379 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b1be8969-45ae-4d4b-8c53-47871114eb7d tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:34.611920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b1be8969-45ae-4d4b-8c53-47871114eb7d tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:34.618546 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b1be8969-45ae-4d4b-8c53-47871114eb7d tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:34.619033 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b1be8969-45ae-4d4b-8c53-47871114eb7d tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:34.619803 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b1be8969-45ae-4d4b-8c53-47871114eb7d tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:34.620237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b1be8969-45ae-4d4b-8c53-47871114eb7d tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:34.752551 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b1be8969-45ae-4d4b-8c53-47871114eb7d tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:34.760553 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b1be8969-45ae-4d4b-8c53-47871114eb7d tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1266 microversion: 2.1 time: 0.153095 Jun 15 16:05:34.761114 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 573/1168] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:34 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:35.777598 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7dbdf56c-0784-4214-a611-a532761e11c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:35.778134 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7dbdf56c-0784-4214-a611-a532761e11c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:35.784487 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7dbdf56c-0784-4214-a611-a532761e11c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:35.784924 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7dbdf56c-0784-4214-a611-a532761e11c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:35.785662 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7dbdf56c-0784-4214-a611-a532761e11c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:35.786085 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7dbdf56c-0784-4214-a611-a532761e11c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:35.913098 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7dbdf56c-0784-4214-a611-a532761e11c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:35.921380 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7dbdf56c-0784-4214-a611-a532761e11c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1266 microversion: 2.1 time: 0.147832 Jun 15 16:05:35.921948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 596/1169] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:35 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:36.938987 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-9e78a859-5eb9-43b7-bbca-f452da6bb000 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:36.939603 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-9e78a859-5eb9-43b7-bbca-f452da6bb000 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:36.946715 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9e78a859-5eb9-43b7-bbca-f452da6bb000 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:36.947219 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9e78a859-5eb9-43b7-bbca-f452da6bb000 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:36.947992 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9e78a859-5eb9-43b7-bbca-f452da6bb000 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:36.948431 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-9e78a859-5eb9-43b7-bbca-f452da6bb000 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:37.075942 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-9e78a859-5eb9-43b7-bbca-f452da6bb000 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:37.083365 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-9e78a859-5eb9-43b7-bbca-f452da6bb000 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1266 microversion: 2.1 time: 0.148378 Jun 15 16:05:37.083927 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 574/1170] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:36 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:38.100224 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-c48b9511-f105-43f2-a784-60306c4b19a0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:38.100831 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-c48b9511-f105-43f2-a784-60306c4b19a0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:38.107390 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c48b9511-f105-43f2-a784-60306c4b19a0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:38.107842 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c48b9511-f105-43f2-a784-60306c4b19a0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:38.108603 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c48b9511-f105-43f2-a784-60306c4b19a0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:38.109036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-c48b9511-f105-43f2-a784-60306c4b19a0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:38.244509 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-c48b9511-f105-43f2-a784-60306c4b19a0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:38.252073 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-c48b9511-f105-43f2-a784-60306c4b19a0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1266 microversion: 2.1 time: 0.155699 Jun 15 16:05:38.252638 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 597/1171] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:38 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:39.269081 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e18a5ff8-5840-4946-ab44-3868c9887112 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:39.269597 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e18a5ff8-5840-4946-ab44-3868c9887112 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:39.272104 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:05:39.277899 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e18a5ff8-5840-4946-ab44-3868c9887112 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:39.278397 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e18a5ff8-5840-4946-ab44-3868c9887112 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:39.279208 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e18a5ff8-5840-4946-ab44-3868c9887112 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:39.279645 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e18a5ff8-5840-4946-ab44-3868c9887112 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:39.408416 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e18a5ff8-5840-4946-ab44-3868c9887112 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:39.415836 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e18a5ff8-5840-4946-ab44-3868c9887112 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1266 microversion: 2.1 time: 0.150750 Jun 15 16:05:39.416403 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 575/1172] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:39 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:40.432738 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-5417e11f-c892-4fc2-855a-87007fdfe8ab tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:40.433347 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-5417e11f-c892-4fc2-855a-87007fdfe8ab tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:40.435317 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=2 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:05:40.436160 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=6 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:05:40.442292 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5417e11f-c892-4fc2-855a-87007fdfe8ab tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:40.442747 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5417e11f-c892-4fc2-855a-87007fdfe8ab tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:40.443507 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5417e11f-c892-4fc2-855a-87007fdfe8ab tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:40.443934 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-5417e11f-c892-4fc2-855a-87007fdfe8ab tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:40.577844 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-5417e11f-c892-4fc2-855a-87007fdfe8ab tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:40.585337 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-5417e11f-c892-4fc2-855a-87007fdfe8ab tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1266 microversion: 2.1 time: 0.156435 Jun 15 16:05:40.585905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 598/1173] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:40 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:41.608980 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-fb607e16-4918-4455-a998-33f2c92572c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:41.609585 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-fb607e16-4918-4455-a998-33f2c92572c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:41.616347 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb607e16-4918-4455-a998-33f2c92572c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:41.616793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb607e16-4918-4455-a998-33f2c92572c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:41.617568 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb607e16-4918-4455-a998-33f2c92572c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:41.618003 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-fb607e16-4918-4455-a998-33f2c92572c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:41.745607 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-fb607e16-4918-4455-a998-33f2c92572c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:41.753016 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-fb607e16-4918-4455-a998-33f2c92572c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1266 microversion: 2.1 time: 0.147919 Jun 15 16:05:41.753576 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 576/1174] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:41 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:42.007046 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-53204b86-1b4a-4e56-b5e2-a010e52c0750 req-0af6b84d-4b53-4a3d-a846-d0b1ffb9cc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35839905-12f5-44c8-aa9d-8c0736d9a25f", "name": "network-vif-plugged", "status": "completed", "tag": "360cf5f3-f5f2-4177-8fb6-d338cab9226e"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:05:42.015522 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-53204b86-1b4a-4e56-b5e2-a010e52c0750 req-0af6b84d-4b53-4a3d-a846-d0b1ffb9cc4b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:42.015953 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-53204b86-1b4a-4e56-b5e2-a010e52c0750 req-0af6b84d-4b53-4a3d-a846-d0b1ffb9cc4b service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:42.027175 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-53204b86-1b4a-4e56-b5e2-a010e52c0750 req-0af6b84d-4b53-4a3d-a846-d0b1ffb9cc4b service nova] Creating event network-vif-plugged:360cf5f3-f5f2-4177-8fb6-d338cab9226e for instance 35839905-12f5-44c8-aa9d-8c0736d9a25f on hv-cinder-84599 Jun 15 16:05:42.031872 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-53204b86-1b4a-4e56-b5e2-a010e52c0750 req-0af6b84d-4b53-4a3d-a846-d0b1ffb9cc4b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028484 Jun 15 16:05:42.032444 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 599/1175] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:05:42.770418 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-de55a341-feb8-4747-9dda-0f3a8090f383 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:42.771054 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-de55a341-feb8-4747-9dda-0f3a8090f383 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:42.777519 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-de55a341-feb8-4747-9dda-0f3a8090f383 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:42.777964 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-de55a341-feb8-4747-9dda-0f3a8090f383 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:42.778716 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-de55a341-feb8-4747-9dda-0f3a8090f383 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:42.779168 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-de55a341-feb8-4747-9dda-0f3a8090f383 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:42.905988 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-de55a341-feb8-4747-9dda-0f3a8090f383 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:42.913647 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-de55a341-feb8-4747-9dda-0f3a8090f383 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1266 microversion: 2.1 time: 0.147211 Jun 15 16:05:42.914220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 577/1176] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:42 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:43.932812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-91874e7a-9592-497c-bb37-0185a7d2a362 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:43.933537 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-91874e7a-9592-497c-bb37-0185a7d2a362 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:43.939699 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-91874e7a-9592-497c-bb37-0185a7d2a362 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:43.940145 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-91874e7a-9592-497c-bb37-0185a7d2a362 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:43.940899 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-91874e7a-9592-497c-bb37-0185a7d2a362 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:43.941329 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-91874e7a-9592-497c-bb37-0185a7d2a362 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:44.073466 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-91874e7a-9592-497c-bb37-0185a7d2a362 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:44.080969 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-91874e7a-9592-497c-bb37-0185a7d2a362 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1452 microversion: 2.1 time: 0.153414 Jun 15 16:05:44.081525 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 600/1177] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:43 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:44.100959 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7526ece1-7881-4a46-a6df-99c837e0a95c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:44.102596 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7526ece1-7881-4a46-a6df-99c837e0a95c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:44.113144 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7526ece1-7881-4a46-a6df-99c837e0a95c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:44.113951 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7526ece1-7881-4a46-a6df-99c837e0a95c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:44.115381 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7526ece1-7881-4a46-a6df-99c837e0a95c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:44.116170 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7526ece1-7881-4a46-a6df-99c837e0a95c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:44.253041 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7526ece1-7881-4a46-a6df-99c837e0a95c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:44.260407 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7526ece1-7881-4a46-a6df-99c837e0a95c tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1452 microversion: 2.1 time: 0.166665 Jun 15 16:05:44.260963 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 578/1178] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:44 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:05:46.027607 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-09fb6142-f28e-4960-be1c-5d6d57fd64ec req-9878a32b-337b-4928-938a-b79bdf4f1d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35839905-12f5-44c8-aa9d-8c0736d9a25f", "tag": "360cf5f3-f5f2-4177-8fb6-d338cab9226e"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:05:46.036299 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-09fb6142-f28e-4960-be1c-5d6d57fd64ec req-9878a32b-337b-4928-938a-b79bdf4f1d60 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:46.036754 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-09fb6142-f28e-4960-be1c-5d6d57fd64ec req-9878a32b-337b-4928-938a-b79bdf4f1d60 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:46.049319 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-09fb6142-f28e-4960-be1c-5d6d57fd64ec req-9878a32b-337b-4928-938a-b79bdf4f1d60 service nova] Creating event network-changed:360cf5f3-f5f2-4177-8fb6-d338cab9226e for instance 35839905-12f5-44c8-aa9d-8c0736d9a25f on hv-cinder-84599 Jun 15 16:05:46.054480 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-09fb6142-f28e-4960-be1c-5d6d57fd64ec req-9878a32b-337b-4928-938a-b79bdf4f1d60 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031035 Jun 15 16:05:46.055535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 601/1179] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 16:05:52.485622 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4cb10a18-63a0-410c-9d15-e0ab5a78c741 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-10013953"}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:05:52.486162 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4cb10a18-63a0-410c-9d15-e0ab5a78c741 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:52.493582 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4cb10a18-63a0-410c-9d15-e0ab5a78c741 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:52.494035 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4cb10a18-63a0-410c-9d15-e0ab5a78c741 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:52.494834 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4cb10a18-63a0-410c-9d15-e0ab5a78c741 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:52.495270 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4cb10a18-63a0-410c-9d15-e0ab5a78c741 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:52.624330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.network.security_group_api [None req-4cb10a18-63a0-410c-9d15-e0ab5a78c741 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Removing security group 6addbcce-7496-4315-b163-2f3ef7d12e3d from port adfa59bb-5cd2-4c3e-88cb-ec3adc25d982 Jun 15 16:05:52.957545 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4cb10a18-63a0-410c-9d15-e0ab5a78c741 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "POST /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/action" status: 202 len: 0 microversion: 2.1 time: 0.475751 Jun 15 16:05:52.962751 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 579/1180] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 16:05:52 2022] POST /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:05:52.967682 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-1f76fa08-b87e-4193-9224-e8fdb0660519 req-b474ea4d-5ca8-4c09-9d64-8c8c908a807d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb374577-499a-4884-a273-19186d6de2bb", "tag": "adfa59bb-5cd2-4c3e-88cb-ec3adc25d982"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:05:52.982666 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-1f76fa08-b87e-4193-9224-e8fdb0660519 req-b474ea4d-5ca8-4c09-9d64-8c8c908a807d service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:52.983513 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-1f76fa08-b87e-4193-9224-e8fdb0660519 req-b474ea4d-5ca8-4c09-9d64-8c8c908a807d service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:52.995926 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-1f76fa08-b87e-4193-9224-e8fdb0660519 req-b474ea4d-5ca8-4c09-9d64-8c8c908a807d service nova] Creating event network-changed:adfa59bb-5cd2-4c3e-88cb-ec3adc25d982 for instance bb374577-499a-4884-a273-19186d6de2bb on hv-cinder-84599 Jun 15 16:05:53.002208 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-1f76fa08-b87e-4193-9224-e8fdb0660519 req-b474ea4d-5ca8-4c09-9d64-8c8c908a807d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038282 Jun 15 16:05:53.003293 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 602/1181] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 15 16:05:54.547368 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-081d01d2-773d-4678-b7cd-6b1edb5aa505 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:54.547854 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-081d01d2-773d-4678-b7cd-6b1edb5aa505 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:54.549709 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:05:54.551232 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-4a1468d7-6acb-4da9-b141-e0392e656e15 req-20bbd849-3428-450e-b2ba-40a5cea1e747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb374577-499a-4884-a273-19186d6de2bb", "tag": "adfa59bb-5cd2-4c3e-88cb-ec3adc25d982"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:05:54.555264 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-081d01d2-773d-4678-b7cd-6b1edb5aa505 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:54.555503 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:05:54.555718 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-081d01d2-773d-4678-b7cd-6b1edb5aa505 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:54.556509 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-081d01d2-773d-4678-b7cd-6b1edb5aa505 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:54.557004 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-081d01d2-773d-4678-b7cd-6b1edb5aa505 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:54.562010 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-4a1468d7-6acb-4da9-b141-e0392e656e15 req-20bbd849-3428-450e-b2ba-40a5cea1e747 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:54.562470 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-4a1468d7-6acb-4da9-b141-e0392e656e15 req-20bbd849-3428-450e-b2ba-40a5cea1e747 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:54.564220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:05:54.567030 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=67 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:05:54.576241 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-4a1468d7-6acb-4da9-b141-e0392e656e15 req-20bbd849-3428-450e-b2ba-40a5cea1e747 service nova] Creating event network-changed:adfa59bb-5cd2-4c3e-88cb-ec3adc25d982 for instance bb374577-499a-4884-a273-19186d6de2bb on hv-cinder-84599 Jun 15 16:05:54.582162 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-4a1468d7-6acb-4da9-b141-e0392e656e15 req-20bbd849-3428-450e-b2ba-40a5cea1e747 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036691 Jun 15 16:05:54.583802 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 603/1182] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:05:54.647744 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-081d01d2-773d-4678-b7cd-6b1edb5aa505 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lazy-loading 'services' on Instance uuid bb374577-499a-4884-a273-19186d6de2bb {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:05:54.734767 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-081d01d2-773d-4678-b7cd-6b1edb5aa505 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/os-volume_attachments/8ddc214e-bfbe-4012-9e71-f3a88ec8207e" status: 202 len: 0 microversion: 2.1 time: 0.191941 Jun 15 16:05:54.735448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 580/1183] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 16:05:54 2022] DELETE /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/os-volume_attachments/8ddc214e-bfbe-4012-9e71-f3a88ec8207e => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:05:54.746900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-d81fd3ba-017a-478d-b252-123b9cdf24c5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:54.748171 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-d81fd3ba-017a-478d-b252-123b9cdf24c5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:54.755478 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d81fd3ba-017a-478d-b252-123b9cdf24c5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:54.756277 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d81fd3ba-017a-478d-b252-123b9cdf24c5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:54.757203 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d81fd3ba-017a-478d-b252-123b9cdf24c5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:54.758143 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-d81fd3ba-017a-478d-b252-123b9cdf24c5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:54.792232 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-d81fd3ba-017a-478d-b252-123b9cdf24c5 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051847 Jun 15 16:05:54.793411 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 604/1184] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 16:05:54 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:05:55.805070 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e7814ae9-bdec-43a7-81c6-0357c4fd7e52 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:55.806160 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e7814ae9-bdec-43a7-81c6-0357c4fd7e52 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:55.812421 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e7814ae9-bdec-43a7-81c6-0357c4fd7e52 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:55.812846 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e7814ae9-bdec-43a7-81c6-0357c4fd7e52 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:55.813600 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e7814ae9-bdec-43a7-81c6-0357c4fd7e52 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:55.814030 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e7814ae9-bdec-43a7-81c6-0357c4fd7e52 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:55.842539 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e7814ae9-bdec-43a7-81c6-0357c4fd7e52 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042361 Jun 15 16:05:55.843116 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 581/1185] 10.222.0.62 () {58 vars in 1301 bytes} [Wed Jun 15 16:05:55 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 15 16:05:55.853095 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-acea9821-fec5-4f02-9310-8b4d8d8d294c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:55.853617 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-acea9821-fec5-4f02-9310-8b4d8d8d294c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:55.860101 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-acea9821-fec5-4f02-9310-8b4d8d8d294c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:55.860542 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-acea9821-fec5-4f02-9310-8b4d8d8d294c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:55.861283 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-acea9821-fec5-4f02-9310-8b4d8d8d294c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:55.861708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-acea9821-fec5-4f02-9310-8b4d8d8d294c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:55.932670 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-acea9821-fec5-4f02-9310-8b4d8d8d294c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] HTTP exception thrown: Instance bb374577-499a-4884-a273-19186d6de2bb is not attached to volume 8ddc214e-bfbe-4012-9e71-f3a88ec8207e Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-acea9821-fec5-4f02-9310-8b4d8d8d294c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Request method failure captured: Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: DELETE /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/os-volume_attachments/8ddc214e-bfbe-4012-9e71-f3a88ec8207e HTTP/1.1 Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgJkEPhS5EXNQguIwD9x8ILQfcHskJQsdCgg0QO4kklM08TgvoDTrXDPXvtEUe8uIYIuG6x9n7IsDJmvjb6yevdw6KlrY42xpi6tVvx3gOxBqoBW6gR7kRNyqvWL7CvyPNVRx4L5DMFofr4kxMn3EANp9zfYRwxF7grcVp9v1VYVSqU Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 4cd1cf864eca4b0eb909e812b7de3f3f Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-TestMinimumBasicScenario-1328055127 Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:05:55.934979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:05:55.936708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4cd1cf864eca4b0eb909e812b7de3f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4cd1cf864eca4b0eb909e812b7de3f3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4cd1cf864eca4b0eb909e812b7de3f3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4cd1cf864eca4b0eb909e812b7de3f3f", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:05:55.936708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-TestMinimumBasicScenario-1328055127 Jun 15 16:05:55.936708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 4cd1cf864eca4b0eb909e812b7de3f3f Jun 15 16:05:55.936708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1328055127 Jun 15 16:05:55.936708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-TestMinimumBasicScenario-1328055127-project Jun 15 16:05:55.936708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:05:55.936708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:05:55.936708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: 12a0715ba0494afd8194655dee4b80ab Jun 15 16:05:55.936708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-TestMinimumBasicScenario-1328055127-project Jun 15 16:05:55.936708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:05:55.936708 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance bb374577-499a-4884-a273-19186d6de2bb is not attached to volume 8ddc214e-bfbe-4012-9e71-f3a88ec8207e Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'server_id': 'bb374577-499a-4884-a273-19186d6de2bb', 'id': '8ddc214e-bfbe-4012-9e71-f3a88ec8207e'} Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8ddc214e-bfbe-4012-9e71-f3a88ec8207e. Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:05:55.937817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb374577-499a-4884-a273-19186d6de2bb is not attached to volume 8ddc214e-bfbe-4012-9e71-f3a88ec8207e Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb374577-499a-4884-a273-19186d6de2bb is not attached to volume 8ddc214e-bfbe-4012-9e71-f3a88ec8207e Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:05:55.939213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-acea9821-fec5-4f02-9310-8b4d8d8d294c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Returning 404 to user: Instance bb374577-499a-4884-a273-19186d6de2bb is not attached to volume 8ddc214e-bfbe-4012-9e71-f3a88ec8207e {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:05:55.940558 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-acea9821-fec5-4f02-9310-8b4d8d8d294c tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/os-volume_attachments/8ddc214e-bfbe-4012-9e71-f3a88ec8207e" status: 404 len: 154 microversion: 2.1 time: 0.087332 Jun 15 16:05:55.940558 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 605/1186] 10.222.0.62 () {58 vars in 1415 bytes} [Wed Jun 15 16:05:55 2022] DELETE /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb/os-volume_attachments/8ddc214e-bfbe-4012-9e71-f3a88ec8207e => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:05:57.068105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-ee84fcff-fad9-488a-963b-75de104ccc0a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:57.068602 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ee84fcff-fad9-488a-963b-75de104ccc0a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:57.075710 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ee84fcff-fad9-488a-963b-75de104ccc0a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:57.076159 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ee84fcff-fad9-488a-963b-75de104ccc0a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:57.076916 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ee84fcff-fad9-488a-963b-75de104ccc0a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:57.077348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-ee84fcff-fad9-488a-963b-75de104ccc0a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:57.100850 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-ee84fcff-fad9-488a-963b-75de104ccc0a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Going to try to terminate instance {{(pid=123935) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 16:05:57.173533 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-ee84fcff-fad9-488a-963b-75de104ccc0a tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "DELETE /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 204 len: 0 microversion: 2.1 time: 0.108955 Jun 15 16:05:57.174535 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 582/1187] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:05:57 2022] DELETE /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 16:05:57.183352 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-3f81b857-18a5-4009-8ed5-6aa00e861a40 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:57.183963 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-3f81b857-18a5-4009-8ed5-6aa00e861a40 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:57.190386 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f81b857-18a5-4009-8ed5-6aa00e861a40 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:57.190878 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f81b857-18a5-4009-8ed5-6aa00e861a40 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:57.191636 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f81b857-18a5-4009-8ed5-6aa00e861a40 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:57.192061 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-3f81b857-18a5-4009-8ed5-6aa00e861a40 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:57.317839 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-3f81b857-18a5-4009-8ed5-6aa00e861a40 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:57.325334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-3f81b857-18a5-4009-8ed5-6aa00e861a40 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1553 microversion: 2.1 time: 0.146520 Jun 15 16:05:57.325900 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 606/1188] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:57 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:58.342576 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-182dadf1-35a1-4c17-9a0d-a11ea269c1bf tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:58.343296 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-182dadf1-35a1-4c17-9a0d-a11ea269c1bf tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:58.349837 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-182dadf1-35a1-4c17-9a0d-a11ea269c1bf tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:58.350280 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-182dadf1-35a1-4c17-9a0d-a11ea269c1bf tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:58.351222 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-182dadf1-35a1-4c17-9a0d-a11ea269c1bf tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:58.351522 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-182dadf1-35a1-4c17-9a0d-a11ea269c1bf tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:58.483206 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-182dadf1-35a1-4c17-9a0d-a11ea269c1bf tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:58.490601 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-182dadf1-35a1-4c17-9a0d-a11ea269c1bf tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1553 microversion: 2.1 time: 0.152083 Jun 15 16:05:58.491191 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 583/1189] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:58 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:05:59.507898 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2bb0adda-2bcc-4b40-996b-f1b67173faf6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:05:59.509040 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2bb0adda-2bcc-4b40-996b-f1b67173faf6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:05:59.515284 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2bb0adda-2bcc-4b40-996b-f1b67173faf6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:59.515727 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2bb0adda-2bcc-4b40-996b-f1b67173faf6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:59.516492 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2bb0adda-2bcc-4b40-996b-f1b67173faf6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:05:59.516995 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2bb0adda-2bcc-4b40-996b-f1b67173faf6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:05:59.643644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2bb0adda-2bcc-4b40-996b-f1b67173faf6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:05:59.651694 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2bb0adda-2bcc-4b40-996b-f1b67173faf6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1553 microversion: 2.1 time: 0.147696 Jun 15 16:05:59.652252 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 607/1190] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:05:59 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:00.478019 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-8c8bd788-9372-4ae5-bf18-2d4de8703cac req-78a43cd0-65d3-4163-a9bc-7971d4988579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb374577-499a-4884-a273-19186d6de2bb", "name": "network-vif-deleted", "tag": "adfa59bb-5cd2-4c3e-88cb-ec3adc25d982"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:06:00.487486 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-8c8bd788-9372-4ae5-bf18-2d4de8703cac req-78a43cd0-65d3-4163-a9bc-7971d4988579 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:00.487924 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-8c8bd788-9372-4ae5-bf18-2d4de8703cac req-78a43cd0-65d3-4163-a9bc-7971d4988579 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:00.500653 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-8c8bd788-9372-4ae5-bf18-2d4de8703cac req-78a43cd0-65d3-4163-a9bc-7971d4988579 service nova] Creating event network-vif-deleted:adfa59bb-5cd2-4c3e-88cb-ec3adc25d982 for instance bb374577-499a-4884-a273-19186d6de2bb on hv-cinder-84599 Jun 15 16:06:00.505769 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-8c8bd788-9372-4ae5-bf18-2d4de8703cac req-78a43cd0-65d3-4163-a9bc-7971d4988579 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032111 Jun 15 16:06:00.506690 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 584/1191] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:06:00.669217 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-fdffc0d1-5189-4d3a-8cab-8a528dbeb4a6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:00.670094 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-fdffc0d1-5189-4d3a-8cab-8a528dbeb4a6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:00.676230 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fdffc0d1-5189-4d3a-8cab-8a528dbeb4a6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:00.676675 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fdffc0d1-5189-4d3a-8cab-8a528dbeb4a6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:00.677431 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fdffc0d1-5189-4d3a-8cab-8a528dbeb4a6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:00.678174 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fdffc0d1-5189-4d3a-8cab-8a528dbeb4a6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:00.708279 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fdffc0d1-5189-4d3a-8cab-8a528dbeb4a6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:00.708658 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fdffc0d1-5189-4d3a-8cab-8a528dbeb4a6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:00.709104 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-fdffc0d1-5189-4d3a-8cab-8a528dbeb4a6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lazy-loading 'fault' on Instance uuid bb374577-499a-4884-a273-19186d6de2bb {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:06:00.753769 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fdffc0d1-5189-4d3a-8cab-8a528dbeb4a6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a0715ba0494afd8194655dee4b80ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd1cf864eca4b0eb909e812b7de3f3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:00.761477 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fdffc0d1-5189-4d3a-8cab-8a528dbeb4a6 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 200 len: 1348 microversion: 2.1 time: 0.097152 Jun 15 16:06:00.762058 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 608/1192] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:00 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:01.780129 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0166d0ab-fa1c-44b1-bd97-b1e8ab205433 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:01.780759 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0166d0ab-fa1c-44b1-bd97-b1e8ab205433 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] [instance: bb374577-499a-4884-a273-19186d6de2bb] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:01.787080 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0166d0ab-fa1c-44b1-bd97-b1e8ab205433 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:01.787537 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0166d0ab-fa1c-44b1-bd97-b1e8ab205433 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:01.788300 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0166d0ab-fa1c-44b1-bd97-b1e8ab205433 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:01.788795 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0166d0ab-fa1c-44b1-bd97-b1e8ab205433 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:01.802204 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-0166d0ab-fa1c-44b1-bd97-b1e8ab205433 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] HTTP exception thrown: Instance bb374577-499a-4884-a273-19186d6de2bb could not be found. Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0166d0ab-fa1c-44b1-bd97-b1e8ab205433 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Request method failure captured: Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb HTTP/1.1 Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgJkEPhS5EXNQguIwD9x8ILQfcHskJQsdCgg0QO4kklM08TgvoDTrXDPXvtEUe8uIYIuG6x9n7IsDJmvjb6yevdw6KlrY42xpi6tVvx3gOxBqoBW6gR7kRNyqvWL7CvyPNVRx4L5DMFofr4kxMn3EANp9zfYRwxF7grcVp9v1VYVSqU Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 4cd1cf864eca4b0eb909e812b7de3f3f Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-TestMinimumBasicScenario-1328055127 Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:06:01.803863 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4cd1cf864eca4b0eb909e812b7de3f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4cd1cf864eca4b0eb909e812b7de3f3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4cd1cf864eca4b0eb909e812b7de3f3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4cd1cf864eca4b0eb909e812b7de3f3f", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-TestMinimumBasicScenario-1328055127 Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 4cd1cf864eca4b0eb909e812b7de3f3f Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1328055127 Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-TestMinimumBasicScenario-1328055127-project Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 12a0715ba0494afd8194655dee4b80ab Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-TestMinimumBasicScenario-1328055127-project Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance bb374577-499a-4884-a273-19186d6de2bb could not be found. Jun 15 16:06:01.805469 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'bb374577-499a-4884-a273-19186d6de2bb'} Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb374577-499a-4884-a273-19186d6de2bb could not be found. Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:06:01.806554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb374577-499a-4884-a273-19186d6de2bb could not be found. Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb374577-499a-4884-a273-19186d6de2bb could not be found. Jun 15 16:06:01.808187 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:06:01.809938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0166d0ab-fa1c-44b1-bd97-b1e8ab205433 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Returning 404 to user: Instance bb374577-499a-4884-a273-19186d6de2bb could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:06:01.809938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0166d0ab-fa1c-44b1-bd97-b1e8ab205433 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb" status: 404 len: 111 microversion: 2.1 time: 0.029927 Jun 15 16:06:01.809938 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 585/1193] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:01 2022] GET /compute/v2.1/servers/bb374577-499a-4884-a273-19186d6de2bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:06:01.813897 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-fd004159-ab90-4966-9f0f-842f51d11c38 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] Calling method '.version_select at 0x7fd8d82e7160>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:01.834513 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fd004159-ab90-4966-9f0f-842f51d11c38 tempest-TestMinimumBasicScenario-1328055127 tempest-TestMinimumBasicScenario-1328055127-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-691801678" status: 202 len: 0 microversion: 2.1 time: 0.024468 Jun 15 16:06:01.835089 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 609/1194] 10.222.0.62 () {58 vars in 1268 bytes} [Wed Jun 15 16:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-691801678 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:06:38.807722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:06:38.808276 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Wed Jun 15 16:06:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:06:45.158244 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0ed7ea4c-f7d6-4a43-951d-07bd7b9231b3 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:06:45.158878 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0ed7ea4c-f7d6-4a43-951d-07bd7b9231b3 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:45.160857 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:06:45.161493 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:06:45.168119 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0ed7ea4c-f7d6-4a43-951d-07bd7b9231b3 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:45.168559 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0ed7ea4c-f7d6-4a43-951d-07bd7b9231b3 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:45.169307 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0ed7ea4c-f7d6-4a43-951d-07bd7b9231b3 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:45.169991 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0ed7ea4c-f7d6-4a43-951d-07bd7b9231b3 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:45.193186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.objects.instance [None req-0ed7ea4c-f7d6-4a43-951d-07bd7b9231b3 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lazy-loading 'flavor' on Instance uuid ed9bf50a-8bee-42fe-a138-3c28a75f5f91 {{(pid=123935) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:06:45.263916 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0ed7ea4c-f7d6-4a43-951d-07bd7b9231b3 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "POST /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91/action" status: 202 len: 0 microversion: 2.1 time: 0.109562 Jun 15 16:06:45.264714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 586/1195] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 16:06:45 2022] POST /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:06:45.270718 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=33 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:06:45.271781 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:06:45.277260 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a225a0d7-5517-4c3b-9125-e9af7beba4f8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:45.277549 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a225a0d7-5517-4c3b-9125-e9af7beba4f8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:45.285280 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a225a0d7-5517-4c3b-9125-e9af7beba4f8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:45.285645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a225a0d7-5517-4c3b-9125-e9af7beba4f8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:45.286548 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a225a0d7-5517-4c3b-9125-e9af7beba4f8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:45.287066 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a225a0d7-5517-4c3b-9125-e9af7beba4f8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:45.422031 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a225a0d7-5517-4c3b-9125-e9af7beba4f8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:45.429543 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a225a0d7-5517-4c3b-9125-e9af7beba4f8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.160456 Jun 15 16:06:45.430124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 610/1196] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:45 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:46.447368 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5da7e2ba-630c-4c51-883e-2d3fbf9d6f7f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:46.448124 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5da7e2ba-630c-4c51-883e-2d3fbf9d6f7f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:46.455205 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5da7e2ba-630c-4c51-883e-2d3fbf9d6f7f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:46.455661 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5da7e2ba-630c-4c51-883e-2d3fbf9d6f7f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:46.456460 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5da7e2ba-630c-4c51-883e-2d3fbf9d6f7f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:46.456903 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5da7e2ba-630c-4c51-883e-2d3fbf9d6f7f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:46.588564 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5da7e2ba-630c-4c51-883e-2d3fbf9d6f7f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:46.596582 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5da7e2ba-630c-4c51-883e-2d3fbf9d6f7f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.153593 Jun 15 16:06:46.597155 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 587/1197] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:46 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:47.614035 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-62ab6d98-62b9-42c8-bc46-1fab2af5b4f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:47.614631 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-62ab6d98-62b9-42c8-bc46-1fab2af5b4f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:47.621546 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-62ab6d98-62b9-42c8-bc46-1fab2af5b4f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:47.621981 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-62ab6d98-62b9-42c8-bc46-1fab2af5b4f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:47.622741 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-62ab6d98-62b9-42c8-bc46-1fab2af5b4f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:47.623174 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-62ab6d98-62b9-42c8-bc46-1fab2af5b4f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:47.748152 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-62ab6d98-62b9-42c8-bc46-1fab2af5b4f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:47.755653 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-62ab6d98-62b9-42c8-bc46-1fab2af5b4f9 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.145451 Jun 15 16:06:47.756213 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 611/1198] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:47 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:48.772641 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-7c967b5b-db84-43c2-80f0-02bbedc7147f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:48.773282 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-7c967b5b-db84-43c2-80f0-02bbedc7147f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:48.780265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c967b5b-db84-43c2-80f0-02bbedc7147f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:48.780714 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c967b5b-db84-43c2-80f0-02bbedc7147f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:48.781481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c967b5b-db84-43c2-80f0-02bbedc7147f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:48.781911 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-7c967b5b-db84-43c2-80f0-02bbedc7147f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:48.912294 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-7c967b5b-db84-43c2-80f0-02bbedc7147f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:48.920538 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-7c967b5b-db84-43c2-80f0-02bbedc7147f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.151772 Jun 15 16:06:48.921100 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 588/1199] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:48 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:49.937811 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-eeb5f334-c97f-41d2-a924-de5a6cd068dc tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:49.938414 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-eeb5f334-c97f-41d2-a924-de5a6cd068dc tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:49.944855 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eeb5f334-c97f-41d2-a924-de5a6cd068dc tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:49.945298 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eeb5f334-c97f-41d2-a924-de5a6cd068dc tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:49.946045 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eeb5f334-c97f-41d2-a924-de5a6cd068dc tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:49.946472 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-eeb5f334-c97f-41d2-a924-de5a6cd068dc tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:50.073152 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-eeb5f334-c97f-41d2-a924-de5a6cd068dc tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:50.080687 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-eeb5f334-c97f-41d2-a924-de5a6cd068dc tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.146732 Jun 15 16:06:50.081247 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 612/1200] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:49 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:51.096814 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-46ac4e74-7fa7-45a9-bb8d-e0ee895f1137 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:51.097448 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-46ac4e74-7fa7-45a9-bb8d-e0ee895f1137 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:51.103955 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-46ac4e74-7fa7-45a9-bb8d-e0ee895f1137 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:51.104402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-46ac4e74-7fa7-45a9-bb8d-e0ee895f1137 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:51.105164 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-46ac4e74-7fa7-45a9-bb8d-e0ee895f1137 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:51.105598 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-46ac4e74-7fa7-45a9-bb8d-e0ee895f1137 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:51.234265 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-46ac4e74-7fa7-45a9-bb8d-e0ee895f1137 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:51.241731 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-46ac4e74-7fa7-45a9-bb8d-e0ee895f1137 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.148793 Jun 15 16:06:51.242367 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 589/1201] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:51 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:52.258928 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-2910693c-7bc5-40ae-af7e-d1cf85a0eab5 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:52.259536 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-2910693c-7bc5-40ae-af7e-d1cf85a0eab5 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:52.266566 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2910693c-7bc5-40ae-af7e-d1cf85a0eab5 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:52.267041 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2910693c-7bc5-40ae-af7e-d1cf85a0eab5 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:52.267786 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2910693c-7bc5-40ae-af7e-d1cf85a0eab5 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:52.268207 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-2910693c-7bc5-40ae-af7e-d1cf85a0eab5 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:52.399347 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-2910693c-7bc5-40ae-af7e-d1cf85a0eab5 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:52.407444 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-2910693c-7bc5-40ae-af7e-d1cf85a0eab5 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.152409 Jun 15 16:06:52.407996 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 613/1202] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:52 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:53.424738 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-abb0bce1-edf2-4567-ab56-232ded28f716 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:53.425352 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-abb0bce1-edf2-4567-ab56-232ded28f716 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:53.431922 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-abb0bce1-edf2-4567-ab56-232ded28f716 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:53.432378 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-abb0bce1-edf2-4567-ab56-232ded28f716 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:53.433180 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-abb0bce1-edf2-4567-ab56-232ded28f716 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:53.433621 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-abb0bce1-edf2-4567-ab56-232ded28f716 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:53.559794 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-abb0bce1-edf2-4567-ab56-232ded28f716 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:53.567241 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-abb0bce1-edf2-4567-ab56-232ded28f716 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.146409 Jun 15 16:06:53.567827 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 590/1203] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:53 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:54.584312 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-601fd0ab-837b-4ed0-a29b-09efa59b1028 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:54.584861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-601fd0ab-837b-4ed0-a29b-09efa59b1028 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:54.591332 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-601fd0ab-837b-4ed0-a29b-09efa59b1028 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:54.591778 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-601fd0ab-837b-4ed0-a29b-09efa59b1028 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:54.592536 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-601fd0ab-837b-4ed0-a29b-09efa59b1028 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:54.592967 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-601fd0ab-837b-4ed0-a29b-09efa59b1028 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:54.722485 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-601fd0ab-837b-4ed0-a29b-09efa59b1028 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:54.730423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-601fd0ab-837b-4ed0-a29b-09efa59b1028 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.150043 Jun 15 16:06:54.731022 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 614/1204] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:54 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:55.747643 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-564ab6c9-8773-4e96-aabb-c655827630a6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:55.748368 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-564ab6c9-8773-4e96-aabb-c655827630a6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:55.754956 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-564ab6c9-8773-4e96-aabb-c655827630a6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:55.755398 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-564ab6c9-8773-4e96-aabb-c655827630a6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:55.756150 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-564ab6c9-8773-4e96-aabb-c655827630a6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:55.756576 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-564ab6c9-8773-4e96-aabb-c655827630a6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:55.891209 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-564ab6c9-8773-4e96-aabb-c655827630a6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:55.899094 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-564ab6c9-8773-4e96-aabb-c655827630a6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.155728 Jun 15 16:06:55.899681 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 591/1205] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:55 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:56.916328 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-35987142-a978-4081-a106-d1d3c1f21073 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:56.917471 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-35987142-a978-4081-a106-d1d3c1f21073 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:56.924389 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-35987142-a978-4081-a106-d1d3c1f21073 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:56.924837 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-35987142-a978-4081-a106-d1d3c1f21073 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:56.925590 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-35987142-a978-4081-a106-d1d3c1f21073 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:56.926024 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-35987142-a978-4081-a106-d1d3c1f21073 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:57.056730 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-35987142-a978-4081-a106-d1d3c1f21073 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:57.064812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-35987142-a978-4081-a106-d1d3c1f21073 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.152369 Jun 15 16:06:57.065372 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 615/1206] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:56 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:58.082426 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-70982b7e-c113-4855-a287-61da650e9f0e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:58.083158 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-70982b7e-c113-4855-a287-61da650e9f0e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:58.090655 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70982b7e-c113-4855-a287-61da650e9f0e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:58.091139 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70982b7e-c113-4855-a287-61da650e9f0e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:58.091914 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70982b7e-c113-4855-a287-61da650e9f0e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:58.092354 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70982b7e-c113-4855-a287-61da650e9f0e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:58.221578 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-70982b7e-c113-4855-a287-61da650e9f0e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:58.229061 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-70982b7e-c113-4855-a287-61da650e9f0e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.151345 Jun 15 16:06:58.229622 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 592/1207] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:58 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:06:59.248191 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-1ca8cf6d-5fc3-4acf-8328-6d066bff7896 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:59.248784 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-1ca8cf6d-5fc3-4acf-8328-6d066bff7896 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:59.255222 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1ca8cf6d-5fc3-4acf-8328-6d066bff7896 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:59.255668 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1ca8cf6d-5fc3-4acf-8328-6d066bff7896 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:59.256423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1ca8cf6d-5fc3-4acf-8328-6d066bff7896 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:59.256853 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-1ca8cf6d-5fc3-4acf-8328-6d066bff7896 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:59.382100 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-1ca8cf6d-5fc3-4acf-8328-6d066bff7896 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:59.389555 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-1ca8cf6d-5fc3-4acf-8328-6d066bff7896 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1509 microversion: 2.1 time: 0.145843 Jun 15 16:06:59.390111 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 616/1208] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:59 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 15 16:06:59.406110 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-080ed3be-a91e-4fd4-bba4-e7827f6f9b47 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:06:59.406684 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-080ed3be-a91e-4fd4-bba4-e7827f6f9b47 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:59.413183 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-080ed3be-a91e-4fd4-bba4-e7827f6f9b47 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:59.413634 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-080ed3be-a91e-4fd4-bba4-e7827f6f9b47 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:59.414588 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-080ed3be-a91e-4fd4-bba4-e7827f6f9b47 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:59.415215 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-080ed3be-a91e-4fd4-bba4-e7827f6f9b47 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:59.493272 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-080ed3be-a91e-4fd4-bba4-e7827f6f9b47 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "POST /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91/action" status: 202 len: 0 microversion: 2.1 time: 0.091586 Jun 15 16:06:59.493869 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 593/1209] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Jun 15 16:06:59 2022] POST /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:06:59.503053 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-da5c12cb-a084-48e5-b72e-8a309a178535 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:06:59.503567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-da5c12cb-a084-48e5-b72e-8a309a178535 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:06:59.509901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-da5c12cb-a084-48e5-b72e-8a309a178535 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:59.510350 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-da5c12cb-a084-48e5-b72e-8a309a178535 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:59.511152 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-da5c12cb-a084-48e5-b72e-8a309a178535 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:06:59.511589 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-da5c12cb-a084-48e5-b72e-8a309a178535 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:06:59.647596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-da5c12cb-a084-48e5-b72e-8a309a178535 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:06:59.655771 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-da5c12cb-a084-48e5-b72e-8a309a178535 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1517 microversion: 2.1 time: 0.156784 Jun 15 16:06:59.656325 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 617/1210] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:06:59 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:07:00.673640 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-a78e2216-1354-4804-8eaa-925806ffeb19 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:07:00.674253 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-a78e2216-1354-4804-8eaa-925806ffeb19 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:07:00.680283 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a78e2216-1354-4804-8eaa-925806ffeb19 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:00.680729 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a78e2216-1354-4804-8eaa-925806ffeb19 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:00.681484 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a78e2216-1354-4804-8eaa-925806ffeb19 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:00.681917 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-a78e2216-1354-4804-8eaa-925806ffeb19 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:00.812947 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-a78e2216-1354-4804-8eaa-925806ffeb19 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:07:00.820701 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-a78e2216-1354-4804-8eaa-925806ffeb19 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1519 microversion: 2.1 time: 0.151556 Jun 15 16:07:00.821267 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 594/1211] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:07:00 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:07:01.838877 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-fe2e0801-55a9-4887-a67b-2a2efbe9484b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:07:01.839476 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-fe2e0801-55a9-4887-a67b-2a2efbe9484b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:07:01.845556 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fe2e0801-55a9-4887-a67b-2a2efbe9484b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:01.845994 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fe2e0801-55a9-4887-a67b-2a2efbe9484b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:01.846758 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fe2e0801-55a9-4887-a67b-2a2efbe9484b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:01.847189 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fe2e0801-55a9-4887-a67b-2a2efbe9484b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:01.976661 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fe2e0801-55a9-4887-a67b-2a2efbe9484b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:07:01.984587 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fe2e0801-55a9-4887-a67b-2a2efbe9484b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1575 microversion: 2.1 time: 0.149605 Jun 15 16:07:01.985347 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 618/1212] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:07:01 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:07:02.368050 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-f753f82a-b421-443f-902c-ba9b6c9acc26 req-b7058067-2bcf-46bb-a2be-08a8d412587d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9bf50a-8bee-42fe-a138-3c28a75f5f91", "name": "network-vif-unplugged", "status": "completed", "tag": "7b567601-7c69-4f08-8731-9cf609b66c38"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:07:02.376944 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-f753f82a-b421-443f-902c-ba9b6c9acc26 req-b7058067-2bcf-46bb-a2be-08a8d412587d service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:02.377130 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-f753f82a-b421-443f-902c-ba9b6c9acc26 req-b7058067-2bcf-46bb-a2be-08a8d412587d service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:02.388091 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-f753f82a-b421-443f-902c-ba9b6c9acc26 req-b7058067-2bcf-46bb-a2be-08a8d412587d service nova] Creating event network-vif-unplugged:7b567601-7c69-4f08-8731-9cf609b66c38 for instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 on hv-cinder-84599 Jun 15 16:07:02.392993 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-f753f82a-b421-443f-902c-ba9b6c9acc26 req-b7058067-2bcf-46bb-a2be-08a8d412587d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028758 Jun 15 16:07:02.393577 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 595/1213] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:07:03.001314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-4a5c7a9c-14a1-4ea7-a744-5380ad4c827f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:07:03.001935 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-4a5c7a9c-14a1-4ea7-a744-5380ad4c827f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:07:03.008652 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a5c7a9c-14a1-4ea7-a744-5380ad4c827f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:03.009098 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a5c7a9c-14a1-4ea7-a744-5380ad4c827f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:03.009856 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a5c7a9c-14a1-4ea7-a744-5380ad4c827f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:03.010291 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-4a5c7a9c-14a1-4ea7-a744-5380ad4c827f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:03.137468 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-4a5c7a9c-14a1-4ea7-a744-5380ad4c827f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:07:03.144921 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-4a5c7a9c-14a1-4ea7-a744-5380ad4c827f tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1575 microversion: 2.1 time: 0.147451 Jun 15 16:07:03.145483 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 619/1214] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:07:02 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:07:04.162913 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6576cb15-ed4d-4626-a701-e18d7679bfa7 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:07:04.163638 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6576cb15-ed4d-4626-a701-e18d7679bfa7 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:07:04.170084 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6576cb15-ed4d-4626-a701-e18d7679bfa7 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:04.171156 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6576cb15-ed4d-4626-a701-e18d7679bfa7 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:04.172086 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6576cb15-ed4d-4626-a701-e18d7679bfa7 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:04.172652 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6576cb15-ed4d-4626-a701-e18d7679bfa7 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:04.303670 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6576cb15-ed4d-4626-a701-e18d7679bfa7 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:07:04.311303 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6576cb15-ed4d-4626-a701-e18d7679bfa7 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1575 microversion: 2.1 time: 0.153312 Jun 15 16:07:04.311876 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 596/1215] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:07:04 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:07:05.328463 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-07118035-73d3-48af-9317-b85598e9bbc8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:07:05.329103 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-07118035-73d3-48af-9317-b85598e9bbc8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:07:05.335614 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-07118035-73d3-48af-9317-b85598e9bbc8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:05.336063 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-07118035-73d3-48af-9317-b85598e9bbc8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:05.336820 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-07118035-73d3-48af-9317-b85598e9bbc8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:05.337252 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-07118035-73d3-48af-9317-b85598e9bbc8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:05.466134 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-07118035-73d3-48af-9317-b85598e9bbc8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:07:05.473695 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-07118035-73d3-48af-9317-b85598e9bbc8 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1575 microversion: 2.1 time: 0.149845 Jun 15 16:07:05.474263 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 620/1216] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:07:05 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:07:06.490037 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5bbbb41a-1248-4f09-9d93-0f2fa8a385ef tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:07:06.490649 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5bbbb41a-1248-4f09-9d93-0f2fa8a385ef tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:07:06.497401 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5bbbb41a-1248-4f09-9d93-0f2fa8a385ef tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:06.497855 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5bbbb41a-1248-4f09-9d93-0f2fa8a385ef tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:06.498622 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5bbbb41a-1248-4f09-9d93-0f2fa8a385ef tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:06.499087 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5bbbb41a-1248-4f09-9d93-0f2fa8a385ef tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:06.627366 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5bbbb41a-1248-4f09-9d93-0f2fa8a385ef tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:07:06.634968 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5bbbb41a-1248-4f09-9d93-0f2fa8a385ef tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1575 microversion: 2.1 time: 0.148824 Jun 15 16:07:06.635532 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 597/1217] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:07:06 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:07:07.652316 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-9ca85304-423c-4d41-998a-8317a52f0a38 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:07:07.652979 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-9ca85304-423c-4d41-998a-8317a52f0a38 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:07:07.659629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9ca85304-423c-4d41-998a-8317a52f0a38 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:07.660068 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9ca85304-423c-4d41-998a-8317a52f0a38 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:07.660813 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9ca85304-423c-4d41-998a-8317a52f0a38 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:07.661234 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-9ca85304-423c-4d41-998a-8317a52f0a38 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:07.786566 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-9ca85304-423c-4d41-998a-8317a52f0a38 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:07:07.794020 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-9ca85304-423c-4d41-998a-8317a52f0a38 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1575 microversion: 2.1 time: 0.145636 Jun 15 16:07:07.794574 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 621/1218] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:07:07 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:07:08.811956 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-24fef826-7365-404a-beb1-2363cb18683b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:07:08.812579 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-24fef826-7365-404a-beb1-2363cb18683b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:07:08.819100 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-24fef826-7365-404a-beb1-2363cb18683b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:08.819543 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-24fef826-7365-404a-beb1-2363cb18683b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:08.820305 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-24fef826-7365-404a-beb1-2363cb18683b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:08.820739 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-24fef826-7365-404a-beb1-2363cb18683b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:08.951825 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-24fef826-7365-404a-beb1-2363cb18683b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:07:08.959535 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-24fef826-7365-404a-beb1-2363cb18683b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1575 microversion: 2.1 time: 0.152270 Jun 15 16:07:08.960102 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 598/1219] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:07:08 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:07:09.976758 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ec3e085e-306b-422f-a859-4d7f80bcabc6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:07:09.977369 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ec3e085e-306b-422f-a859-4d7f80bcabc6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:07:09.984082 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ec3e085e-306b-422f-a859-4d7f80bcabc6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:09.984552 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ec3e085e-306b-422f-a859-4d7f80bcabc6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:09.985326 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ec3e085e-306b-422f-a859-4d7f80bcabc6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:09.985751 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ec3e085e-306b-422f-a859-4d7f80bcabc6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:10.119789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ec3e085e-306b-422f-a859-4d7f80bcabc6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:07:10.127852 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ec3e085e-306b-422f-a859-4d7f80bcabc6 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1575 microversion: 2.1 time: 0.154944 Jun 15 16:07:10.128413 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 622/1220] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:07:09 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:07:11.144810 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-0fd796e3-af81-4ecc-b5c8-446319c1ffcd tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:07:11.145423 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-0fd796e3-af81-4ecc-b5c8-446319c1ffcd tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:07:11.152110 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fd796e3-af81-4ecc-b5c8-446319c1ffcd tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:11.152616 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fd796e3-af81-4ecc-b5c8-446319c1ffcd tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:11.153358 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fd796e3-af81-4ecc-b5c8-446319c1ffcd tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:11.153794 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-0fd796e3-af81-4ecc-b5c8-446319c1ffcd tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:11.283599 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-0fd796e3-af81-4ecc-b5c8-446319c1ffcd tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:07:11.291127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-0fd796e3-af81-4ecc-b5c8-446319c1ffcd tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1562 microversion: 2.1 time: 0.150364 Jun 15 16:07:11.291686 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 599/1221] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:07:11 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:07:12.528376 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-161be344-d244-4b4a-a829-5846ee03f005 req-ef4bd8fd-8c86-44db-8388-dd323ecc89c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9bf50a-8bee-42fe-a138-3c28a75f5f91", "name": "network-vif-plugged", "status": "completed", "tag": "7b567601-7c69-4f08-8731-9cf609b66c38"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:07:12.536629 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-161be344-d244-4b4a-a829-5846ee03f005 req-ef4bd8fd-8c86-44db-8388-dd323ecc89c0 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:07:12.537069 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-161be344-d244-4b4a-a829-5846ee03f005 req-ef4bd8fd-8c86-44db-8388-dd323ecc89c0 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:07:12.548908 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-161be344-d244-4b4a-a829-5846ee03f005 req-ef4bd8fd-8c86-44db-8388-dd323ecc89c0 service nova] Creating event network-vif-plugged:7b567601-7c69-4f08-8731-9cf609b66c38 for instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 on hv-cinder-84599 Jun 15 16:07:12.553725 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-161be344-d244-4b4a-a829-5846ee03f005 req-ef4bd8fd-8c86-44db-8388-dd323ecc89c0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092861 Jun 15 16:07:12.554317 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 623/1222] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:08:15.174666 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=30 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:08:15.175444 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:08:15.179323 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-615573102", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2141088859", "security_groups": [{"name": "tempest-secgroup-smoke-662739945"}], "block_device_mapping_v2": [{"uuid": "228686d4-5f30-425c-9334-540bb9b8a8b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9b3187a5-ab83-4eae-958d-943b33483207"}]}} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:08:15.290419 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.network.neutron [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] validate_networks() for [('9b3187a5-ab83-4eae-958d-943b33483207', None, None, None, None, None)] {{(pid=123935) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 15 16:08:15.699951 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Flavor limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 15 16:08:15.700379 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Image limits 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 15 16:08:15.700851 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Flavor pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 15 16:08:15.701260 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Image pref 0:0:0 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 15 16:08:15.701672 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.virt.hardware [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123935) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 15 16:08:15.710871 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:15.711320 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:15.712108 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:15.712543 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:15.732353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Getting quotas for project 31480d73f44447679761a5acac79dc02. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 15 16:08:15.736245 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.quota [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Getting quotas for user f18270589e8745a286e3c78a7f86b25d and project 31480d73f44447679761a5acac79dc02. Resources: {'instances', 'cores', 'ram'} {{(pid=123935) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 15 16:08:15.791339 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Going to run 1 instances... {{(pid=123935) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 15 16:08:15.793389 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='228686d4-5f30-425c-9334-540bb9b8a8b4',volume_size=None,volume_type=None)] {{(pid=123935) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 15 16:08:15.924897 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-4a7959a8-f297-4195-94a8-5a22c8f26b88 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.752402 Jun 15 16:08:15.925526 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 600/1223] 10.222.0.62 () {60 vars in 1146 bytes} [Wed Jun 15 16:08:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 15 16:08:15.934057 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=28 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:08:15.934972 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=80 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:08:15.940129 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ed46d89b-1a5e-46ea-8243-54906616f6fb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:15.940817 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ed46d89b-1a5e-46ea-8243-54906616f6fb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:15.993596 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ed46d89b-1a5e-46ea-8243-54906616f6fb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:16.000112 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ed46d89b-1a5e-46ea-8243-54906616f6fb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1094 microversion: 2.1 time: 0.068432 Jun 15 16:08:16.000666 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 624/1224] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:15 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:17.017585 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-36b4a17e-5f78-473a-b15a-e5e3ff9bb967 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:17.018059 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-36b4a17e-5f78-473a-b15a-e5e3ff9bb967 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:17.069186 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-36b4a17e-5f78-473a-b15a-e5e3ff9bb967 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:17.075826 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-36b4a17e-5f78-473a-b15a-e5e3ff9bb967 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1094 microversion: 2.1 time: 0.062886 Jun 15 16:08:17.076391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 601/1225] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:17 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:17.889567 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:08:17.890131 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 16:08:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:08:18.092290 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-f940c1f0-a7f5-459b-ab91-95a5306b3673 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:18.092893 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-f940c1f0-a7f5-459b-ab91-95a5306b3673 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:18.146865 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-f940c1f0-a7f5-459b-ab91-95a5306b3673 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:18.153731 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-f940c1f0-a7f5-459b-ab91-95a5306b3673 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1094 microversion: 2.1 time: 0.065243 Jun 15 16:08:18.154268 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 625/1226] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:18 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:19.171330 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b1234b32-0292-452f-9987-26e41ffa2865 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:19.171941 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b1234b32-0292-452f-9987-26e41ffa2865 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:19.228107 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b1234b32-0292-452f-9987-26e41ffa2865 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:19.234848 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b1234b32-0292-452f-9987-26e41ffa2865 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1094 microversion: 2.1 time: 0.067613 Jun 15 16:08:19.235948 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 602/1227] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:19 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:20.252309 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-943c2800-824e-4380-8ffa-699abbeea68f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:20.252925 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-943c2800-824e-4380-8ffa-699abbeea68f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:20.259696 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-943c2800-824e-4380-8ffa-699abbeea68f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:20.260146 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-943c2800-824e-4380-8ffa-699abbeea68f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:20.260907 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-943c2800-824e-4380-8ffa-699abbeea68f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:20.261343 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-943c2800-824e-4380-8ffa-699abbeea68f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:20.321334 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-943c2800-824e-4380-8ffa-699abbeea68f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:20.329645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-943c2800-824e-4380-8ffa-699abbeea68f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1144 microversion: 2.1 time: 0.081388 Jun 15 16:08:20.330214 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 626/1228] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:20 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:21.346933 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-940e57ad-2024-4611-8046-321309ae5c16 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:21.347576 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-940e57ad-2024-4611-8046-321309ae5c16 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:21.354342 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-940e57ad-2024-4611-8046-321309ae5c16 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:21.354830 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-940e57ad-2024-4611-8046-321309ae5c16 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:21.355602 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-940e57ad-2024-4611-8046-321309ae5c16 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:21.356044 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-940e57ad-2024-4611-8046-321309ae5c16 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:21.420011 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-940e57ad-2024-4611-8046-321309ae5c16 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:21.429030 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-940e57ad-2024-4611-8046-321309ae5c16 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1210 microversion: 2.1 time: 0.086462 Jun 15 16:08:21.429608 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 603/1229] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:21 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:22.399787 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-9c6a2c18-9562-41e9-b5a7-edd05b4b4189 req-f424d06d-c008-48a9-a794-3c8e4e9e89de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95102b12-d0ae-4282-97d5-b1a779d48231", "tag": "8f4f829a-4fa6-4e3e-8794-41f36ff9fefd"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:08:22.408528 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-9c6a2c18-9562-41e9-b5a7-edd05b4b4189 req-f424d06d-c008-48a9-a794-3c8e4e9e89de service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:22.409662 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-9c6a2c18-9562-41e9-b5a7-edd05b4b4189 req-f424d06d-c008-48a9-a794-3c8e4e9e89de service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:22.426027 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-9c6a2c18-9562-41e9-b5a7-edd05b4b4189 req-f424d06d-c008-48a9-a794-3c8e4e9e89de service nova] Creating event network-changed:8f4f829a-4fa6-4e3e-8794-41f36ff9fefd for instance 95102b12-d0ae-4282-97d5-b1a779d48231 on hv-cinder-84599 Jun 15 16:08:22.431166 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-9c6a2c18-9562-41e9-b5a7-edd05b4b4189 req-f424d06d-c008-48a9-a794-3c8e4e9e89de service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118255 Jun 15 16:08:22.432320 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 627/1230] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:08:22.446511 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-b569d5f9-d86e-42ea-a862-260972f055b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:22.447180 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-b569d5f9-d86e-42ea-a862-260972f055b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:22.454884 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b569d5f9-d86e-42ea-a862-260972f055b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:22.455334 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b569d5f9-d86e-42ea-a862-260972f055b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:22.456164 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b569d5f9-d86e-42ea-a862-260972f055b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:22.456602 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-b569d5f9-d86e-42ea-a862-260972f055b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:22.591648 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-b569d5f9-d86e-42ea-a862-260972f055b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:22.599796 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-b569d5f9-d86e-42ea-a862-260972f055b3 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.157191 Jun 15 16:08:22.600368 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 604/1231] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:22 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:23.618038 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-dc644195-b8eb-4d57-9cca-8f5f71076c2a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:23.618748 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-dc644195-b8eb-4d57-9cca-8f5f71076c2a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:23.625071 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dc644195-b8eb-4d57-9cca-8f5f71076c2a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:23.625574 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dc644195-b8eb-4d57-9cca-8f5f71076c2a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:23.626329 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dc644195-b8eb-4d57-9cca-8f5f71076c2a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:23.626785 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-dc644195-b8eb-4d57-9cca-8f5f71076c2a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:23.756001 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-dc644195-b8eb-4d57-9cca-8f5f71076c2a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:23.764499 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-dc644195-b8eb-4d57-9cca-8f5f71076c2a tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.151062 Jun 15 16:08:23.765391 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 628/1232] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:23 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:24.014445 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:08:24.014698 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 16:08:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:08:24.782094 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-17b34385-e115-48ae-9032-b4d6a383587f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:24.782804 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-17b34385-e115-48ae-9032-b4d6a383587f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:24.790029 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-17b34385-e115-48ae-9032-b4d6a383587f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:24.790549 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-17b34385-e115-48ae-9032-b4d6a383587f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:24.791353 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-17b34385-e115-48ae-9032-b4d6a383587f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:24.791793 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-17b34385-e115-48ae-9032-b4d6a383587f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:24.918974 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-17b34385-e115-48ae-9032-b4d6a383587f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:24.927280 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-17b34385-e115-48ae-9032-b4d6a383587f tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.149152 Jun 15 16:08:24.927844 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 605/1233] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:24 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:25.944602 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-00746b4a-2c04-42e4-bfcd-98f77f00de90 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:25.945197 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-00746b4a-2c04-42e4-bfcd-98f77f00de90 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:25.951824 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00746b4a-2c04-42e4-bfcd-98f77f00de90 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:25.952272 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00746b4a-2c04-42e4-bfcd-98f77f00de90 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:25.953027 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00746b4a-2c04-42e4-bfcd-98f77f00de90 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:25.953458 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-00746b4a-2c04-42e4-bfcd-98f77f00de90 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:26.083691 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-00746b4a-2c04-42e4-bfcd-98f77f00de90 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:26.091036 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-00746b4a-2c04-42e4-bfcd-98f77f00de90 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.150320 Jun 15 16:08:26.091595 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 629/1234] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:25 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:27.107644 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6070c69f-3a0d-4b90-b43a-debc6b8b36bb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:27.108233 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6070c69f-3a0d-4b90-b43a-debc6b8b36bb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:27.110088 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=2 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:08:27.115722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6070c69f-3a0d-4b90-b43a-debc6b8b36bb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:27.116166 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6070c69f-3a0d-4b90-b43a-debc6b8b36bb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:27.116915 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6070c69f-3a0d-4b90-b43a-debc6b8b36bb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:27.117345 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6070c69f-3a0d-4b90-b43a-debc6b8b36bb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:27.245543 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-6070c69f-3a0d-4b90-b43a-debc6b8b36bb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:27.252900 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6070c69f-3a0d-4b90-b43a-debc6b8b36bb tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.149126 Jun 15 16:08:27.253453 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 606/1235] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:27 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:28.269434 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-76aa8a63-bf14-4443-a274-0a23b273edd9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:28.269977 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-76aa8a63-bf14-4443-a274-0a23b273edd9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:28.272259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell0:SELECT=4 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:08:28.277958 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-76aa8a63-bf14-4443-a274-0a23b273edd9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:28.278407 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-76aa8a63-bf14-4443-a274-0a23b273edd9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:28.279199 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-76aa8a63-bf14-4443-a274-0a23b273edd9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:28.279633 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-76aa8a63-bf14-4443-a274-0a23b273edd9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:28.411079 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-76aa8a63-bf14-4443-a274-0a23b273edd9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:28.418429 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-76aa8a63-bf14-4443-a274-0a23b273edd9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.152900 Jun 15 16:08:28.419007 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 630/1236] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:28 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:29.436043 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-cb84740c-94db-40e2-b48e-74788a1794c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:29.436653 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-cb84740c-94db-40e2-b48e-74788a1794c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:29.441218 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell0:SELECT=10 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:08:29.445237 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cb84740c-94db-40e2-b48e-74788a1794c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:29.445686 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cb84740c-94db-40e2-b48e-74788a1794c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:29.446449 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cb84740c-94db-40e2-b48e-74788a1794c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:29.446908 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-cb84740c-94db-40e2-b48e-74788a1794c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:29.573197 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-cb84740c-94db-40e2-b48e-74788a1794c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:29.582515 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-cb84740c-94db-40e2-b48e-74788a1794c0 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.150393 Jun 15 16:08:29.583116 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 607/1237] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:29 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:30.599314 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-7a4b6ed6-b4ce-4464-b331-3bcbf1de4aca tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:30.599854 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-7a4b6ed6-b4ce-4464-b331-3bcbf1de4aca tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:30.605855 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7a4b6ed6-b4ce-4464-b331-3bcbf1de4aca tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:30.606310 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7a4b6ed6-b4ce-4464-b331-3bcbf1de4aca tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:30.607101 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7a4b6ed6-b4ce-4464-b331-3bcbf1de4aca tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:30.607535 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-7a4b6ed6-b4ce-4464-b331-3bcbf1de4aca tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:30.741985 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-7a4b6ed6-b4ce-4464-b331-3bcbf1de4aca tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:30.749414 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-7a4b6ed6-b4ce-4464-b331-3bcbf1de4aca tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.154276 Jun 15 16:08:30.749978 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 631/1238] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:30 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:31.767440 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-70ac7182-ae4e-49ba-98b2-20d98fa9b0d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:31.768078 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-70ac7182-ae4e-49ba-98b2-20d98fa9b0d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:31.774583 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70ac7182-ae4e-49ba-98b2-20d98fa9b0d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:31.775066 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70ac7182-ae4e-49ba-98b2-20d98fa9b0d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:31.775830 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70ac7182-ae4e-49ba-98b2-20d98fa9b0d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:31.776266 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-70ac7182-ae4e-49ba-98b2-20d98fa9b0d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:31.908412 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-70ac7182-ae4e-49ba-98b2-20d98fa9b0d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:31.915887 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-70ac7182-ae4e-49ba-98b2-20d98fa9b0d5 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.152819 Jun 15 16:08:31.916451 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 608/1239] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:31 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:32.933275 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-716aea40-f0ce-4585-be11-38471b664206 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:32.933819 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-716aea40-f0ce-4585-be11-38471b664206 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:32.940301 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-716aea40-f0ce-4585-be11-38471b664206 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:32.940740 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-716aea40-f0ce-4585-be11-38471b664206 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:32.941482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-716aea40-f0ce-4585-be11-38471b664206 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:32.941905 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-716aea40-f0ce-4585-be11-38471b664206 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:33.067364 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-716aea40-f0ce-4585-be11-38471b664206 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:33.074615 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-716aea40-f0ce-4585-be11-38471b664206 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.145191 Jun 15 16:08:33.075198 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 632/1240] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:32 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:34.092046 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2e60680c-ee8d-4811-9ccb-cfabcc3663ff tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:34.092639 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2e60680c-ee8d-4811-9ccb-cfabcc3663ff tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:34.099220 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2e60680c-ee8d-4811-9ccb-cfabcc3663ff tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:34.099671 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2e60680c-ee8d-4811-9ccb-cfabcc3663ff tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:34.100430 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2e60680c-ee8d-4811-9ccb-cfabcc3663ff tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:34.100862 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2e60680c-ee8d-4811-9ccb-cfabcc3663ff tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:34.485510 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2e60680c-ee8d-4811-9ccb-cfabcc3663ff tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:34.493041 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2e60680c-ee8d-4811-9ccb-cfabcc3663ff tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.405043 Jun 15 16:08:34.493611 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 609/1241] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:34 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:34.811468 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-b598d21b-2a01-47bf-9935-5d7cd56a4eab req-c0f5bd98-9a2d-421e-9dc6-7c13ca6c38e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95102b12-d0ae-4282-97d5-b1a779d48231", "name": "network-vif-plugged", "status": "completed", "tag": "8f4f829a-4fa6-4e3e-8794-41f36ff9fefd"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:08:34.820811 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-b598d21b-2a01-47bf-9935-5d7cd56a4eab req-c0f5bd98-9a2d-421e-9dc6-7c13ca6c38e1 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:34.821262 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-b598d21b-2a01-47bf-9935-5d7cd56a4eab req-c0f5bd98-9a2d-421e-9dc6-7c13ca6c38e1 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:34.833462 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-b598d21b-2a01-47bf-9935-5d7cd56a4eab req-c0f5bd98-9a2d-421e-9dc6-7c13ca6c38e1 service nova] Creating event network-vif-plugged:8f4f829a-4fa6-4e3e-8794-41f36ff9fefd for instance 95102b12-d0ae-4282-97d5-b1a779d48231 on hv-cinder-84599 Jun 15 16:08:34.838632 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-b598d21b-2a01-47bf-9935-5d7cd56a4eab req-c0f5bd98-9a2d-421e-9dc6-7c13ca6c38e1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030897 Jun 15 16:08:34.839254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 633/1242] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:08:35.509991 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5a7778f8-a598-479d-a26e-0a8367a4f203 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:35.510607 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5a7778f8-a598-479d-a26e-0a8367a4f203 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:35.517224 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5a7778f8-a598-479d-a26e-0a8367a4f203 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:35.517681 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5a7778f8-a598-479d-a26e-0a8367a4f203 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:35.518447 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5a7778f8-a598-479d-a26e-0a8367a4f203 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:35.518925 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5a7778f8-a598-479d-a26e-0a8367a4f203 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:35.647916 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-5a7778f8-a598-479d-a26e-0a8367a4f203 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:35.655385 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5a7778f8-a598-479d-a26e-0a8367a4f203 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1265 microversion: 2.1 time: 0.149338 Jun 15 16:08:35.655951 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 610/1243] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:35 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:36.674479 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-89de2249-c82e-41dd-a116-98ce3a12b925 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:36.675808 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-89de2249-c82e-41dd-a116-98ce3a12b925 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:36.682206 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89de2249-c82e-41dd-a116-98ce3a12b925 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:36.682651 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89de2249-c82e-41dd-a116-98ce3a12b925 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:36.683453 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89de2249-c82e-41dd-a116-98ce3a12b925 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:36.683888 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-89de2249-c82e-41dd-a116-98ce3a12b925 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:36.815080 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-89de2249-c82e-41dd-a116-98ce3a12b925 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:36.822705 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-89de2249-c82e-41dd-a116-98ce3a12b925 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1450 microversion: 2.1 time: 0.153999 Jun 15 16:08:36.823297 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 634/1244] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:36 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1450 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:36.839104 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-e6367049-da9f-4d3f-a744-008a72fd1e5b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:36.839744 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-e6367049-da9f-4d3f-a744-008a72fd1e5b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:36.846745 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6367049-da9f-4d3f-a744-008a72fd1e5b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:36.847209 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6367049-da9f-4d3f-a744-008a72fd1e5b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:36.847970 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6367049-da9f-4d3f-a744-008a72fd1e5b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:36.848401 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-e6367049-da9f-4d3f-a744-008a72fd1e5b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:36.975221 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-e6367049-da9f-4d3f-a744-008a72fd1e5b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:36.982873 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-e6367049-da9f-4d3f-a744-008a72fd1e5b tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1450 microversion: 2.1 time: 0.147544 Jun 15 16:08:36.983439 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 611/1245] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:36 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:38.671617 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-91c64b35-6a25-405e-ade8-b7f40a8847c4 req-dc4b974b-882d-4ab8-90e6-ca7deca20c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95102b12-d0ae-4282-97d5-b1a779d48231", "tag": "8f4f829a-4fa6-4e3e-8794-41f36ff9fefd"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:08:38.679484 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-91c64b35-6a25-405e-ade8-b7f40a8847c4 req-dc4b974b-882d-4ab8-90e6-ca7deca20c64 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:38.679912 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-91c64b35-6a25-405e-ade8-b7f40a8847c4 req-dc4b974b-882d-4ab8-90e6-ca7deca20c64 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:38.691081 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-91c64b35-6a25-405e-ade8-b7f40a8847c4 req-dc4b974b-882d-4ab8-90e6-ca7deca20c64 service nova] Creating event network-changed:8f4f829a-4fa6-4e3e-8794-41f36ff9fefd for instance 95102b12-d0ae-4282-97d5-b1a779d48231 on hv-cinder-84599 Jun 15 16:08:38.696105 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-91c64b35-6a25-405e-ade8-b7f40a8847c4 req-dc4b974b-882d-4ab8-90e6-ca7deca20c64 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082264 Jun 15 16:08:38.696735 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 635/1246] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:08:50.235024 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-f7b0d943-2687-4cdb-89a9-0b02bd5a3017 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:50.236142 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=28 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:08:50.236520 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f7b0d943-2687-4cdb-89a9-0b02bd5a3017 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:50.236621 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=48 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:08:50.238934 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:08:50.240068 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=56 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:08:50.241614 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-97c92914-d8f0-428c-90ab-c064bb17f4b9 req-6bb149b2-6863-4ff2-a4f1-ce755dae0cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9bf50a-8bee-42fe-a138-3c28a75f5f91", "tag": "7b567601-7c69-4f08-8731-9cf609b66c38"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:08:50.246707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f7b0d943-2687-4cdb-89a9-0b02bd5a3017 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:50.247268 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f7b0d943-2687-4cdb-89a9-0b02bd5a3017 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:50.248124 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f7b0d943-2687-4cdb-89a9-0b02bd5a3017 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:50.248640 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-f7b0d943-2687-4cdb-89a9-0b02bd5a3017 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:50.251301 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-97c92914-d8f0-428c-90ab-c064bb17f4b9 req-6bb149b2-6863-4ff2-a4f1-ce755dae0cf8 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:50.252184 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-97c92914-d8f0-428c-90ab-c064bb17f4b9 req-6bb149b2-6863-4ff2-a4f1-ce755dae0cf8 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:50.263551 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-97c92914-d8f0-428c-90ab-c064bb17f4b9 req-6bb149b2-6863-4ff2-a4f1-ce755dae0cf8 service nova] Creating event network-changed:7b567601-7c69-4f08-8731-9cf609b66c38 for instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 on hv-cinder-84599 Jun 15 16:08:50.268648 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-97c92914-d8f0-428c-90ab-c064bb17f4b9 req-6bb149b2-6863-4ff2-a4f1-ce755dae0cf8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035045 Jun 15 16:08:50.269503 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 636/1247] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:08:50.277099 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-f7b0d943-2687-4cdb-89a9-0b02bd5a3017 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Going to try to terminate instance {{(pid=123935) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 16:08:50.371990 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-f7b0d943-2687-4cdb-89a9-0b02bd5a3017 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 204 len: 0 microversion: 2.1 time: 0.140313 Jun 15 16:08:50.373412 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 612/1248] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:08:50 2022] DELETE /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 16:08:50.382080 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-a0878b6f-36d6-47df-9116-0558c0a4961e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:50.382693 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-a0878b6f-36d6-47df-9116-0558c0a4961e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:50.389137 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a0878b6f-36d6-47df-9116-0558c0a4961e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:50.389593 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a0878b6f-36d6-47df-9116-0558c0a4961e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:50.390504 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a0878b6f-36d6-47df-9116-0558c0a4961e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:50.390973 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-a0878b6f-36d6-47df-9116-0558c0a4961e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:50.530414 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-a0878b6f-36d6-47df-9116-0558c0a4961e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:50.538520 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-a0878b6f-36d6-47df-9116-0558c0a4961e tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.160666 Jun 15 16:08:50.539183 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 637/1249] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:50 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:51.557552 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-d2348606-e7ae-45af-b91a-e16927b53a95 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:51.558196 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-d2348606-e7ae-45af-b91a-e16927b53a95 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:51.564881 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d2348606-e7ae-45af-b91a-e16927b53a95 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:51.565333 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d2348606-e7ae-45af-b91a-e16927b53a95 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:51.566096 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d2348606-e7ae-45af-b91a-e16927b53a95 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:51.566531 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-d2348606-e7ae-45af-b91a-e16927b53a95 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:51.699113 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-d2348606-e7ae-45af-b91a-e16927b53a95 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:51.707309 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-d2348606-e7ae-45af-b91a-e16927b53a95 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1568 microversion: 2.1 time: 0.154052 Jun 15 16:08:51.707868 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 613/1250] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:51 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:52.725084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-fe36cfe4-f747-4b04-a6b8-0a9afad77a77 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:52.725696 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-fe36cfe4-f747-4b04-a6b8-0a9afad77a77 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:52.732589 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fe36cfe4-f747-4b04-a6b8-0a9afad77a77 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:52.733034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fe36cfe4-f747-4b04-a6b8-0a9afad77a77 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:52.733805 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fe36cfe4-f747-4b04-a6b8-0a9afad77a77 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:52.734237 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-fe36cfe4-f747-4b04-a6b8-0a9afad77a77 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:52.872235 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-fe36cfe4-f747-4b04-a6b8-0a9afad77a77 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:52.880574 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-fe36cfe4-f747-4b04-a6b8-0a9afad77a77 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1450 microversion: 2.1 time: 0.159354 Jun 15 16:08:52.890031 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 638/1251] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:52 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:53.143794 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [req-66297a2b-9a3f-4721-b081-09d7a26765d4 req-bec4ad2c-5e64-496f-9fe9-3854f7cfb457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9bf50a-8bee-42fe-a138-3c28a75f5f91", "name": "network-vif-deleted", "tag": "7b567601-7c69-4f08-8731-9cf609b66c38"}]} {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:08:53.153258 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-66297a2b-9a3f-4721-b081-09d7a26765d4 req-bec4ad2c-5e64-496f-9fe9-3854f7cfb457 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:53.153782 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [req-66297a2b-9a3f-4721-b081-09d7a26765d4 req-bec4ad2c-5e64-496f-9fe9-3854f7cfb457 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:53.166708 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.compute.server_external_events [req-66297a2b-9a3f-4721-b081-09d7a26765d4 req-bec4ad2c-5e64-496f-9fe9-3854f7cfb457 service nova] Creating event network-vif-deleted:7b567601-7c69-4f08-8731-9cf609b66c38 for instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 on hv-cinder-84599 Jun 15 16:08:53.171985 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [req-66297a2b-9a3f-4721-b081-09d7a26765d4 req-bec4ad2c-5e64-496f-9fe9-3854f7cfb457 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032178 Jun 15 16:08:53.172761 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 614/1252] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:08:53.897054 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-cac32a21-ee98-4ae9-896f-7371e0f93640 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:53.897645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-cac32a21-ee98-4ae9-896f-7371e0f93640 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:53.904149 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cac32a21-ee98-4ae9-896f-7371e0f93640 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:53.904594 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cac32a21-ee98-4ae9-896f-7371e0f93640 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:53.905341 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cac32a21-ee98-4ae9-896f-7371e0f93640 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:53.905767 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cac32a21-ee98-4ae9-896f-7371e0f93640 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:53.939909 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cac32a21-ee98-4ae9-896f-7371e0f93640 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:53.940350 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-cac32a21-ee98-4ae9-896f-7371e0f93640 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:53.940846 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.objects.instance [None req-cac32a21-ee98-4ae9-896f-7371e0f93640 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lazy-loading 'fault' on Instance uuid ed9bf50a-8bee-42fe-a138-3c28a75f5f91 {{(pid=123934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 15 16:08:53.981574 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-cac32a21-ee98-4ae9-896f-7371e0f93640 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e42d4cebe14642a71209ddd2b25fd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202b681b581b4f6ea4fe9fcbf049c185', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:08:53.991015 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-cac32a21-ee98-4ae9-896f-7371e0f93640 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 200 len: 1224 microversion: 2.1 time: 0.097614 Jun 15 16:08:53.991684 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 639/1253] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:53 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:08:55.010397 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8aca638a-faa2-4ff8-b28f-96ee36048d62 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:55.011045 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-8aca638a-faa2-4ff8-b28f-96ee36048d62 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] [instance: ed9bf50a-8bee-42fe-a138-3c28a75f5f91] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:08:55.017855 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8aca638a-faa2-4ff8-b28f-96ee36048d62 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:55.018338 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8aca638a-faa2-4ff8-b28f-96ee36048d62 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:55.019139 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8aca638a-faa2-4ff8-b28f-96ee36048d62 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:08:55.019579 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-8aca638a-faa2-4ff8-b28f-96ee36048d62 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:08:55.032713 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-8aca638a-faa2-4ff8-b28f-96ee36048d62 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] HTTP exception thrown: Instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 could not be found. Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8aca638a-faa2-4ff8-b28f-96ee36048d62 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Request method failure captured: Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 HTTP/1.1 Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgLPi8_KqQgRbkVdv51YGAU95EZsBBTfPSH5dllJzfSVzqCvO4EYpJfZgqPHa4zc1Z5YN4pDHC-SLBi-LzDOFYwvQSIbKqULTeJ58274EApjmvUX6g6FLW4zlyxSgpdDWcEvWIpTolFSQKCC3Bgp22Af9VwhGu825f86GtRcSoZ-3JA Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 202b681b581b4f6ea4fe9fcbf049c185 Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-TestShelveInstance-685727316 Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:08:55.034319 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/202b681b581b4f6ea4fe9fcbf049c185"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/202b681b581b4f6ea4fe9fcbf049c185"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/202b681b581b4f6ea4fe9fcbf049c185"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_202b681b581b4f6ea4fe9fcbf049c185", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-TestShelveInstance-685727316 Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 202b681b581b4f6ea4fe9fcbf049c185 Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-TestShelveInstance-685727316 Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-TestShelveInstance-685727316-project Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: 34e42d4cebe14642a71209ddd2b25fd2 Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-TestShelveInstance-685727316-project Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 could not be found. Jun 15 16:08:55.036123 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': 'ed9bf50a-8bee-42fe-a138-3c28a75f5f91'} Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 could not be found. Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:08:55.037179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 could not be found. Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 could not be found. Jun 15 16:08:55.038920 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:08:55.040588 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-8aca638a-faa2-4ff8-b28f-96ee36048d62 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Returning 404 to user: Instance ed9bf50a-8bee-42fe-a138-3c28a75f5f91 could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:08:55.040588 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-8aca638a-faa2-4ff8-b28f-96ee36048d62 tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91" status: 404 len: 111 microversion: 2.1 time: 0.030121 Jun 15 16:08:55.040588 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 615/1254] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:08:55 2022] GET /compute/v2.1/servers/ed9bf50a-8bee-42fe-a138-3c28a75f5f91 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:08:55.195666 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-15120a21-06b3-401a-b1be-3baa0dc5f53b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] Calling method '.version_select at 0x7fd8dc0063a0>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:08:55.219156 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-15120a21-06b3-401a-b1be-3baa0dc5f53b tempest-TestShelveInstance-685727316 tempest-TestShelveInstance-685727316-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1844540297" status: 202 len: 0 microversion: 2.1 time: 0.027703 Jun 15 16:08:55.219735 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 640/1255] 10.222.0.62 () {58 vars in 1253 bytes} [Wed Jun 15 16:08:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1844540297 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:09:58.816700 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:09:58.817218 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Wed Jun 15 16:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:10:28.283707 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:10:28.284792 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG dbcounter [-] [123935] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123935) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:10:28.287338 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_cell1:SELECT=22 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:10:28.288257 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG dbcounter [-] [123934] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=123934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 16:10:28.289946 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-5b198b19-4dbb-4fe5-90d7-b94c1859cef9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:28.290536 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5b198b19-4dbb-4fe5-90d7-b94c1859cef9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:28.293012 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-cbf8504b-c6fa-4eb4-8d3d-4458d31971e9 req-896c6f90-0d89-451e-afff-2716f6c98417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95102b12-d0ae-4282-97d5-b1a779d48231", "tag": "8f4f829a-4fa6-4e3e-8794-41f36ff9fefd"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:10:28.303104 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b198b19-4dbb-4fe5-90d7-b94c1859cef9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:28.303662 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b198b19-4dbb-4fe5-90d7-b94c1859cef9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:28.304008 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-cbf8504b-c6fa-4eb4-8d3d-4458d31971e9 req-896c6f90-0d89-451e-afff-2716f6c98417 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:28.304585 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b198b19-4dbb-4fe5-90d7-b94c1859cef9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:28.304861 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-cbf8504b-c6fa-4eb4-8d3d-4458d31971e9 req-896c6f90-0d89-451e-afff-2716f6c98417 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:28.305094 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-5b198b19-4dbb-4fe5-90d7-b94c1859cef9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:28.315846 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-cbf8504b-c6fa-4eb4-8d3d-4458d31971e9 req-896c6f90-0d89-451e-afff-2716f6c98417 service nova] Creating event network-changed:8f4f829a-4fa6-4e3e-8794-41f36ff9fefd for instance 95102b12-d0ae-4282-97d5-b1a779d48231 on hv-cinder-84599 Jun 15 16:10:28.321595 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-cbf8504b-c6fa-4eb4-8d3d-4458d31971e9 req-896c6f90-0d89-451e-afff-2716f6c98417 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035883 Jun 15 16:10:28.322711 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 641/1256] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:10:28.332701 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-5b198b19-4dbb-4fe5-90d7-b94c1859cef9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Going to try to terminate instance {{(pid=123935) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 16:10:28.421028 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-5b198b19-4dbb-4fe5-90d7-b94c1859cef9 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "DELETE /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 204 len: 0 microversion: 2.1 time: 0.138946 Jun 15 16:10:28.422594 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 616/1257] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:10:28 2022] DELETE /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 16:10:28.432034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ab8e3701-ebb9-4f90-b03d-3f5c9b0a9b79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:28.433073 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ab8e3701-ebb9-4f90-b03d-3f5c9b0a9b79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:28.443344 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab8e3701-ebb9-4f90-b03d-3f5c9b0a9b79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:28.443789 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab8e3701-ebb9-4f90-b03d-3f5c9b0a9b79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:28.444914 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab8e3701-ebb9-4f90-b03d-3f5c9b0a9b79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:28.445549 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ab8e3701-ebb9-4f90-b03d-3f5c9b0a9b79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:28.769148 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-ab8e3701-ebb9-4f90-b03d-3f5c9b0a9b79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:10:28.776718 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ab8e3701-ebb9-4f90-b03d-3f5c9b0a9b79 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1575 microversion: 2.1 time: 0.349490 Jun 15 16:10:28.777289 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 642/1258] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:10:28 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1575 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:10:29.847849 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-2167c4be-856b-491e-a9d8-29fb960de155 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:29.848546 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-2167c4be-856b-491e-a9d8-29fb960de155 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:29.855192 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2167c4be-856b-491e-a9d8-29fb960de155 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:29.855586 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2167c4be-856b-491e-a9d8-29fb960de155 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:29.856352 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2167c4be-856b-491e-a9d8-29fb960de155 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:29.856788 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-2167c4be-856b-491e-a9d8-29fb960de155 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:30.038641 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-2167c4be-856b-491e-a9d8-29fb960de155 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:10:30.046094 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-2167c4be-856b-491e-a9d8-29fb960de155 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1575 microversion: 2.1 time: 0.202511 Jun 15 16:10:30.046651 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 617/1259] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:10:29 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:10:30.682482 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-e000acf7-5e89-4f63-9696-d1ae36b7872e req-b432e422-f867-402c-ada3-5032e8a73c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95102b12-d0ae-4282-97d5-b1a779d48231", "name": "network-vif-deleted", "tag": "8f4f829a-4fa6-4e3e-8794-41f36ff9fefd"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:10:30.690424 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-e000acf7-5e89-4f63-9696-d1ae36b7872e req-b432e422-f867-402c-ada3-5032e8a73c06 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:30.690909 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-e000acf7-5e89-4f63-9696-d1ae36b7872e req-b432e422-f867-402c-ada3-5032e8a73c06 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:30.701984 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-e000acf7-5e89-4f63-9696-d1ae36b7872e req-b432e422-f867-402c-ada3-5032e8a73c06 service nova] Creating event network-vif-deleted:8f4f829a-4fa6-4e3e-8794-41f36ff9fefd for instance 95102b12-d0ae-4282-97d5-b1a779d48231 on hv-cinder-84599 Jun 15 16:10:30.706901 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-e000acf7-5e89-4f63-9696-d1ae36b7872e req-b432e422-f867-402c-ada3-5032e8a73c06 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028151 Jun 15 16:10:30.707510 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 643/1260] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:10:31.064073 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-32f2825e-3f1c-4562-939b-60d528b345c6 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:31.065271 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-32f2825e-3f1c-4562-939b-60d528b345c6 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:31.073391 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32f2825e-3f1c-4562-939b-60d528b345c6 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:31.073841 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32f2825e-3f1c-4562-939b-60d528b345c6 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:31.074660 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32f2825e-3f1c-4562-939b-60d528b345c6 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:31.075127 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-32f2825e-3f1c-4562-939b-60d528b345c6 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:31.142025 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-32f2825e-3f1c-4562-939b-60d528b345c6 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:10:31.150394 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-32f2825e-3f1c-4562-939b-60d528b345c6 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 200 len: 1225 microversion: 2.1 time: 0.090177 Jun 15 16:10:31.150992 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 618/1261] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:10:31 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:10:32.168803 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ea915911-5ed3-4a90-8887-9d0bab511560 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:32.169487 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-ea915911-5ed3-4a90-8887-9d0bab511560 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 95102b12-d0ae-4282-97d5-b1a779d48231] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:32.175992 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ea915911-5ed3-4a90-8887-9d0bab511560 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:32.176436 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ea915911-5ed3-4a90-8887-9d0bab511560 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:32.177191 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ea915911-5ed3-4a90-8887-9d0bab511560 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:32.177621 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-ea915911-5ed3-4a90-8887-9d0bab511560 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:32.190469 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-ea915911-5ed3-4a90-8887-9d0bab511560 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] HTTP exception thrown: Instance 95102b12-d0ae-4282-97d5-b1a779d48231 could not be found. Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ea915911-5ed3-4a90-8887-9d0bab511560 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Request method failure captured: Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 HTTP/1.1 Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgJNDY0-ArjL_k1voyQ1R0pPU12yHKBq2oXaHVTTBGeM6ikjfq1mIiOt6pa3PVxmXSacUXhkA3HWhRI2JGZXHmIetpgGKiHbvNal3rceaDJ-lwU4d0_mMkwMwD3e-YVgNtvKIs2caqyx3kDeS8GpEnzP8jnOxUAIa_pWBOULoR8cH0o Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 31480d73f44447679761a5acac79dc02 Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:10:32.192078 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31480d73f44447679761a5acac79dc02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31480d73f44447679761a5acac79dc02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31480d73f44447679761a5acac79dc02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31480d73f44447679761a5acac79dc02", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 31480d73f44447679761a5acac79dc02 Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-TestVolumeBootPattern-1112771182-project Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: f18270589e8745a286e3c78a7f86b25d Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-TestVolumeBootPattern-1112771182-project Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 95102b12-d0ae-4282-97d5-b1a779d48231 could not be found. Jun 15 16:10:32.193676 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '95102b12-d0ae-4282-97d5-b1a779d48231'} Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95102b12-d0ae-4282-97d5-b1a779d48231 could not be found. Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:10:32.194640 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95102b12-d0ae-4282-97d5-b1a779d48231 could not be found. Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95102b12-d0ae-4282-97d5-b1a779d48231 could not be found. Jun 15 16:10:32.196442 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:32.198067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-ea915911-5ed3-4a90-8887-9d0bab511560 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Returning 404 to user: Instance 95102b12-d0ae-4282-97d5-b1a779d48231 could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:10:32.198067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-ea915911-5ed3-4a90-8887-9d0bab511560 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231" status: 404 len: 111 microversion: 2.1 time: 0.029431 Jun 15 16:10:32.198067 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 644/1262] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:10:32 2022] GET /compute/v2.1/servers/95102b12-d0ae-4282-97d5-b1a779d48231 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:10:35.487554 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-33abe758-17c8-4108-b26f-5785dcb4559e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:35.488083 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-33abe758-17c8-4108-b26f-5785dcb4559e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:35.489221 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-31bff08e-cb45-450a-9b9e-13ad7830087a req-65689e86-e81c-41d5-b31c-bdd49b7d2c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35839905-12f5-44c8-aa9d-8c0736d9a25f", "tag": "360cf5f3-f5f2-4177-8fb6-d338cab9226e"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:10:35.494945 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33abe758-17c8-4108-b26f-5785dcb4559e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:35.495393 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33abe758-17c8-4108-b26f-5785dcb4559e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:35.496148 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33abe758-17c8-4108-b26f-5785dcb4559e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:35.496569 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-33abe758-17c8-4108-b26f-5785dcb4559e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:35.498590 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-31bff08e-cb45-450a-9b9e-13ad7830087a req-65689e86-e81c-41d5-b31c-bdd49b7d2c32 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:35.499124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-31bff08e-cb45-450a-9b9e-13ad7830087a req-65689e86-e81c-41d5-b31c-bdd49b7d2c32 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:35.510796 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-31bff08e-cb45-450a-9b9e-13ad7830087a req-65689e86-e81c-41d5-b31c-bdd49b7d2c32 service nova] Creating event network-changed:360cf5f3-f5f2-4177-8fb6-d338cab9226e for instance 35839905-12f5-44c8-aa9d-8c0736d9a25f on hv-cinder-84599 Jun 15 16:10:35.516029 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-31bff08e-cb45-450a-9b9e-13ad7830087a req-65689e86-e81c-41d5-b31c-bdd49b7d2c32 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030592 Jun 15 16:10:35.516614 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 645/1263] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:10:35.521481 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-33abe758-17c8-4108-b26f-5785dcb4559e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Going to try to terminate instance {{(pid=123935) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 15 16:10:35.601406 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-33abe758-17c8-4108-b26f-5785dcb4559e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "DELETE /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 204 len: 0 microversion: 2.1 time: 0.117402 Jun 15 16:10:35.605875 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 619/1264] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:10:35 2022] DELETE /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 15 16:10:35.612383 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-13f680bd-37cd-4954-a27b-1ff73c24c273 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:35.613084 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-13f680bd-37cd-4954-a27b-1ff73c24c273 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:35.619894 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-13f680bd-37cd-4954-a27b-1ff73c24c273 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:35.620335 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-13f680bd-37cd-4954-a27b-1ff73c24c273 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:35.621104 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-13f680bd-37cd-4954-a27b-1ff73c24c273 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:35.621527 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-13f680bd-37cd-4954-a27b-1ff73c24c273 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:35.756714 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.policy [None req-13f680bd-37cd-4954-a27b-1ff73c24c273 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123934) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:10:35.764531 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-13f680bd-37cd-4954-a27b-1ff73c24c273 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1577 microversion: 2.1 time: 0.157833 Jun 15 16:10:35.765296 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 646/1265] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:10:35 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:10:36.782006 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-58279c5b-0792-4b8f-b743-59db6eb91b72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:36.782708 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-58279c5b-0792-4b8f-b743-59db6eb91b72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:36.789082 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58279c5b-0792-4b8f-b743-59db6eb91b72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:36.789527 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58279c5b-0792-4b8f-b743-59db6eb91b72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:36.790293 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58279c5b-0792-4b8f-b743-59db6eb91b72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:36.790722 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-58279c5b-0792-4b8f-b743-59db6eb91b72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:36.958588 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-58279c5b-0792-4b8f-b743-59db6eb91b72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:10:36.966129 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-58279c5b-0792-4b8f-b743-59db6eb91b72 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1577 microversion: 2.1 time: 0.188399 Jun 15 16:10:36.966694 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 620/1266] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:10:36 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:10:37.743423 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [req-34a932ec-e461-44e2-a102-49f2a856d927 req-080616df-02df-46a4-a293-1e5fa4e2f5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35839905-12f5-44c8-aa9d-8c0736d9a25f", "name": "network-vif-deleted", "tag": "360cf5f3-f5f2-4177-8fb6-d338cab9226e"}]} {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 15 16:10:37.752129 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-34a932ec-e461-44e2-a102-49f2a856d927 req-080616df-02df-46a4-a293-1e5fa4e2f5a5 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:37.752561 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [req-34a932ec-e461-44e2-a102-49f2a856d927 req-080616df-02df-46a4-a293-1e5fa4e2f5a5 service nova] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:37.763799 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.compute.server_external_events [req-34a932ec-e461-44e2-a102-49f2a856d927 req-080616df-02df-46a4-a293-1e5fa4e2f5a5 service nova] Creating event network-vif-deleted:360cf5f3-f5f2-4177-8fb6-d338cab9226e for instance 35839905-12f5-44c8-aa9d-8c0736d9a25f on hv-cinder-84599 Jun 15 16:10:37.768435 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [req-34a932ec-e461-44e2-a102-49f2a856d927 req-080616df-02df-46a4-a293-1e5fa4e2f5a5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028693 Jun 15 16:10:37.769146 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 647/1267] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Jun 15 16:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 15 16:10:37.985038 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c3480904-f984-48b6-8f01-7dea3b53b01e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:37.985592 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-c3480904-f984-48b6-8f01-7dea3b53b01e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:37.991916 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c3480904-f984-48b6-8f01-7dea3b53b01e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:37.992360 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c3480904-f984-48b6-8f01-7dea3b53b01e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:37.993110 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c3480904-f984-48b6-8f01-7dea3b53b01e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:37.993539 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-c3480904-f984-48b6-8f01-7dea3b53b01e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:38.074087 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.policy [None req-c3480904-f984-48b6-8f01-7dea3b53b01e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f18270589e8745a286e3c78a7f86b25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31480d73f44447679761a5acac79dc02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123935) authorize /opt/stack/nova/nova/policy.py:199}} Jun 15 16:10:38.082347 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c3480904-f984-48b6-8f01-7dea3b53b01e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 200 len: 1226 microversion: 2.1 time: 0.101615 Jun 15 16:10:38.084402 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 621/1268] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:10:37 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 15 16:10:39.100914 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-798f792c-8691-4215-9056-c28b196c3279 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:39.101637 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-798f792c-8691-4215-9056-c28b196c3279 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 35839905-12f5-44c8-aa9d-8c0736d9a25f] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:39.107999 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-798f792c-8691-4215-9056-c28b196c3279 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:39.108447 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-798f792c-8691-4215-9056-c28b196c3279 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:39.109203 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-798f792c-8691-4215-9056-c28b196c3279 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:39.109636 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-798f792c-8691-4215-9056-c28b196c3279 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:39.122644 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-798f792c-8691-4215-9056-c28b196c3279 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] HTTP exception thrown: Instance 35839905-12f5-44c8-aa9d-8c0736d9a25f could not be found. Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-798f792c-8691-4215-9056-c28b196c3279 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Request method failure captured: Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f HTTP/1.1 Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgJNDY0-ArjL_k1voyQ1R0pPU12yHKBq2oXaHVTTBGeM6ikjfq1mIiOt6pa3PVxmXSacUXhkA3HWhRI2JGZXHmIetpgGKiHbvNal3rceaDJ-lwU4d0_mMkwMwD3e-YVgNtvKIs2caqyx3kDeS8GpEnzP8jnOxUAIa_pWBOULoR8cH0o Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 31480d73f44447679761a5acac79dc02 Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:10:39.124254 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31480d73f44447679761a5acac79dc02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31480d73f44447679761a5acac79dc02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31480d73f44447679761a5acac79dc02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31480d73f44447679761a5acac79dc02", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 31480d73f44447679761a5acac79dc02 Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-TestVolumeBootPattern-1112771182-project Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: f18270589e8745a286e3c78a7f86b25d Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-TestVolumeBootPattern-1112771182-project Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 35839905-12f5-44c8-aa9d-8c0736d9a25f could not be found. Jun 15 16:10:39.125948 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '35839905-12f5-44c8-aa9d-8c0736d9a25f'} Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35839905-12f5-44c8-aa9d-8c0736d9a25f could not be found. Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:10:39.127124 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35839905-12f5-44c8-aa9d-8c0736d9a25f could not be found. Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35839905-12f5-44c8-aa9d-8c0736d9a25f could not be found. Jun 15 16:10:39.128697 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.130362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-798f792c-8691-4215-9056-c28b196c3279 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Returning 404 to user: Instance 35839905-12f5-44c8-aa9d-8c0736d9a25f could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:10:39.130362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-798f792c-8691-4215-9056-c28b196c3279 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f" status: 404 len: 111 microversion: 2.1 time: 0.030198 Jun 15 16:10:39.130362 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 648/1269] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:10:39 2022] GET /compute/v2.1/servers/35839905-12f5-44c8-aa9d-8c0736d9a25f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:10:39.566756 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6a365b10-e9e7-431f-98ee-e0ca8c17fcaa tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:39.567245 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.compute.api [None req-6a365b10-e9e7-431f-98ee-e0ca8c17fcaa tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123935) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:39.574283 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6a365b10-e9e7-431f-98ee-e0ca8c17fcaa tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:39.574750 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6a365b10-e9e7-431f-98ee-e0ca8c17fcaa tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:39.575523 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6a365b10-e9e7-431f-98ee-e0ca8c17fcaa tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:39.575943 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG oslo_concurrency.lockutils [None req-6a365b10-e9e7-431f-98ee-e0ca8c17fcaa tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123935) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:39.589440 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.wsgi [None req-6a365b10-e9e7-431f-98ee-e0ca8c17fcaa tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] HTTP exception thrown: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6a365b10-e9e7-431f-98ee-e0ca8c17fcaa tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Request method failure captured: Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: request: DELETE /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 HTTP/1.1 Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept: application/json Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Accept-Encoding: identity Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Connection: close Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Length: 0 Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Content-Type: application/json Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Host: 10.222.0.62 Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Openstack-System-Scope: None Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: User-Agent: python-urllib3/1.26.9 Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Auth-Token: gAAAAABiqgJNDY0-ArjL_k1voyQ1R0pPU12yHKBq2oXaHVTTBGeM6ikjfq1mIiOt6pa3PVxmXSacUXhkA3HWhRI2JGZXHmIetpgGKiHbvNal3rceaDJ-lwU4d0_mMkwMwD3e-YVgNtvKIs2caqyx3kDeS8GpEnzP8jnOxUAIa_pWBOULoR8cH0o Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Id: None Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Domain-Name: None Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Identity-Status: Confirmed Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Is-Admin-Project: True Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Id: default Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Domain-Name: Default Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Id: 31480d73f44447679761a5acac79dc02 Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Project-Name: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Role: member,reader Jun 15 16:10:39.591105 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Roles: member,reader Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31480d73f44447679761a5acac79dc02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31480d73f44447679761a5acac79dc02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31480d73f44447679761a5acac79dc02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31480d73f44447679761a5acac79dc02", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Id: 31480d73f44447679761a5acac79dc02 Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-Tenant-Name: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User: tempest-TestVolumeBootPattern-1112771182-project Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Id: default Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Domain-Name: Default Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Id: f18270589e8745a286e3c78a7f86b25d Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: X-User-Name: tempest-TestVolumeBootPattern-1112771182-project Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: method: > Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: exception: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:10:39.592664 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: action_args: {'id': '6e337762-1c2f-446b-b266-8a491f6f3a94'} Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:10:39.593540 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:10:39.594973 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.596348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-6a365b10-e9e7-431f-98ee-e0ca8c17fcaa tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Returning 404 to user: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. {{(pid=123935) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:10:39.596348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-6a365b10-e9e7-431f-98ee-e0ca8c17fcaa tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 404 len: 111 microversion: 2.1 time: 0.029586 Jun 15 16:10:39.596348 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 622/1270] 10.222.0.62 () {58 vars in 1238 bytes} [Wed Jun 15 16:10:39 2022] DELETE /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:10:39.601641 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-912ce11f-7fd5-46c2-85c3-a914ac1c7b4e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '>' {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:39.602272 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.compute.api [None req-912ce11f-7fd5-46c2-85c3-a914ac1c7b4e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] [instance: 6e337762-1c2f-446b-b266-8a491f6f3a94] Fetching instance by UUID {{(pid=123934) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 15 16:10:39.608175 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-912ce11f-7fd5-46c2-85c3-a914ac1c7b4e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:39.608621 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-912ce11f-7fd5-46c2-85c3-a914ac1c7b4e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:39.609365 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-912ce11f-7fd5-46c2-85c3-a914ac1c7b4e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 15 16:10:39.609793 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG oslo_concurrency.lockutils [None req-912ce11f-7fd5-46c2-85c3-a914ac1c7b4e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Lock "a7cda08c-8d99-4c22-b02a-df5ced6c50f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 15 16:10:39.623410 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.wsgi [None req-912ce11f-7fd5-46c2-85c3-a914ac1c7b4e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] HTTP exception thrown: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-912ce11f-7fd5-46c2-85c3-a914ac1c7b4e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Request method failure captured: Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: request: GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 HTTP/1.1 Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept: application/json Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Accept-Encoding: identity Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Connection: close Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Length: 0 Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Content-Type: application/json Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Host: 10.222.0.62 Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Openstack-System-Scope: None Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: User-Agent: python-urllib3/1.26.9 Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Auth-Token: gAAAAABiqgJNDY0-ArjL_k1voyQ1R0pPU12yHKBq2oXaHVTTBGeM6ikjfq1mIiOt6pa3PVxmXSacUXhkA3HWhRI2JGZXHmIetpgGKiHbvNal3rceaDJ-lwU4d0_mMkwMwD3e-YVgNtvKIs2caqyx3kDeS8GpEnzP8jnOxUAIa_pWBOULoR8cH0o Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Id: None Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Domain-Name: None Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Identity-Status: Confirmed Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Is-Admin-Project: True Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Id: default Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Domain-Name: Default Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Id: 31480d73f44447679761a5acac79dc02 Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Project-Name: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Role: member,reader Jun 15 16:10:39.624885 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Roles: member,reader Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/31480d73f44447679761a5acac79dc02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31480d73f44447679761a5acac79dc02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/31480d73f44447679761a5acac79dc02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_31480d73f44447679761a5acac79dc02", "adminURL": "http://10.222.0.62:8080"}]}] Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Id: 31480d73f44447679761a5acac79dc02 Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-Tenant-Name: tempest-TestVolumeBootPattern-1112771182 Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User: tempest-TestVolumeBootPattern-1112771182-project Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Id: default Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Domain-Name: Default Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Id: f18270589e8745a286e3c78a7f86b25d Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: X-User-Name: tempest-TestVolumeBootPattern-1112771182-project Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: method: > Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: exception: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:10:39.626645 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: action_args: {'id': '6e337762-1c2f-446b-b266-8a491f6f3a94'} Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: {{(pid=123934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 15 16:10:39.628034 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. Jun 15 16:10:39.631259 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: ERROR nova.api.openstack.wsgi Jun 15 16:10:39.632866 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: DEBUG nova.api.openstack.wsgi [None req-912ce11f-7fd5-46c2-85c3-a914ac1c7b4e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Returning 404 to user: Instance 6e337762-1c2f-446b-b266-8a491f6f3a94 could not be found. {{(pid=123934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 15 16:10:39.632866 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO nova.api.openstack.requestlog [None req-912ce11f-7fd5-46c2-85c3-a914ac1c7b4e tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94" status: 404 len: 111 microversion: 2.1 time: 0.029146 Jun 15 16:10:39.632866 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: [pid: 123934|app: 0|req: 649/1271] 10.222.0.62 () {58 vars in 1235 bytes} [Wed Jun 15 16:10:39 2022] GET /compute/v2.1/servers/6e337762-1c2f-446b-b266-8a491f6f3a94 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 15 16:10:40.909514 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: DEBUG nova.api.openstack.wsgi [None req-c4b8576d-ce12-46b9-8dca-9e3092b71c43 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] Calling method '.version_select at 0x7fd8d830b670>' {{(pid=123935) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 15 16:10:40.932638 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO nova.api.openstack.requestlog [None req-c4b8576d-ce12-46b9-8dca-9e3092b71c43 tempest-TestVolumeBootPattern-1112771182 tempest-TestVolumeBootPattern-1112771182-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2141088859" status: 202 len: 0 microversion: 2.1 time: 0.026790 Jun 15 16:10:40.933179 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: [pid: 123935|app: 0|req: 623/1272] 10.222.0.62 () {58 vars in 1262 bytes} [Wed Jun 15 16:10:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2141088859 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 15 16:11:37.898220 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:11:37.898878 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 16:11:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:11:44.023209 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:11:44.023847 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 16:11:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:13:18.824950 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:13:18.825537 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Wed Jun 15 16:13:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:13:26.017529 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:13:26.018291 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Wed Jun 15 16:13:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:13:37.075221 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:13:37.075812 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 16:13:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:13:44.706954 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:13:44.707464 dv-cinder-845990-1-iscsi devstack@n-api.service[123935]: Wed Jun 15 16:13:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:14:57.906435 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:14:57.907609 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 16:14:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 15 16:15:04.031276 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 15 16:15:04.032416 dv-cinder-845990-1-iscsi devstack@n-api.service[123934]: Wed Jun 15 16:15:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!